Best Practices for Collecting Speed Test Data

10 Pages Posted: 15 Aug 2022

See all articles by Kyle MacMillan

Kyle MacMillan

University of Chicago

Tarun Mangla

University of Chicago

Marc Richardson

University of Chicago

Nick Feamster

University of Chicago

Date Written: August 12, 2022

Abstract

In an effort to expand Internet access, local and federal policymakers have sought to use speed test data to determine where to allocate funding. However, drawing accurate and meaningful conclusions about Internet Service Provider (ISP) network performance from speed test data requires careful consideration of the test conditions under which the data was collected. This paper provides a set of recommendations for gathering and analyzing a single speed test measurement. Our recommendations are based on our own analysis of speed test data collected from in-lab, controlled experiments, as well as from a six month long deployment across 77 households in Chicago. Based on the results of our analysis, we suggest that the client-server latency, the client device, and the access medium (wireless vs. wired) be logged for each test. These three metadata can be used later to assess the accuracy or utility of the speed test. We also propose that running “paired tests” (running two different speed tests in succession) can help mitigate the effects of test conditions for which we can’t measure, such as server load or upstream congestion. Such paired tests are most beneficial for households subscribed to download speeds greater than 500 Mbps.

Keywords: Broadband, speed test, digital divide

Suggested Citation

MacMillan, Kyle and Mangla, Tarun and Richardson, Marc and Feamster, Nick, Best Practices for Collecting Speed Test Data (August 12, 2022). Available at SSRN: https://ssrn.com/abstract=4189044 or http://dx.doi.org/10.2139/ssrn.4189044

Kyle MacMillan (Contact Author)

University of Chicago ( email )

1101 East 58th Street
Chicago, IL 60637
United States

Tarun Mangla

University of Chicago ( email )

1101 East 58th Street
Chicago, IL 60637
United States

Marc Richardson

University of Chicago ( email )

1101 East 58th Street
Chicago, IL 60637
United States

Nick Feamster

University of Chicago ( email )

Chicago, IL
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
232
Abstract Views
697
Rank
240,245
PlumX Metrics