🤖 AI Summary
This study addresses the challenge of isolating performance anomalies in the middle-mile segment of Internet paths—such as topology errors, suboptimal routing policies, and interconnection congestion—from end-host effects. Leveraging Measurement Lab (M-Lab) data, the authors employ a natural experiment design: users from the same access ISP connect to multiple geographically proximate M-Lab servers, enabling an A/B comparison that effectively controls for client-side, access-network, and temporal variability. This approach, applied at scale for the first time, uncovers previously masked middle-mile anomalies and enables joint detection of topological, routing, and congestion issues. Using a sparse multidimensional histogram method on BigQuery, the system computes Kolmogorov–Smirnov distances and geometric mean throughput ratios in a single pass over millions of samples, efficiently identifying bandwidth bottlenecks, traffic shaping, and suboptimal routes. Results are made publicly accessible through a metropolitan-level real-time dashboard supporting fine-grained analysis.
📝 Abstract
Separating mid-path Internet performance from edge effects remains a fundamental challenge in network measurement. This paper presents a methodology for detecting anomalous topology, routing policies, and congested interconnections using controlled A/B comparisons derived from Measurement Lab (M-Lab) data. The approach leverages M-Lab's uniform server selection policy: by comparing performance distributions from clients in the same access ISP to different nearby M-Lab servers, natural experiments are created that isolate mid-path effects while controlling for client-side variation, access network bottlenecks, and diurnal variation in test volume. This analysis is implemented in BigQuery using sparse multidimensional histograms enabling efficient computation of Kolmogorov-Smirnov distance and ratios of geometric mean throughput across many millions of measurements in a single pass. Differences in throughput suggest mid-path bandwidth bottlenecks or traffic management; excess differences in minimum RTT suggest suboptimal routing. These signals of interconnection problems are extracted from the noise deliberately suppressed by other measurement approaches. Public dashboards provide ongoing visibility into all M-Lab metropolitan regions with sufficient servers, with drill-down capability to individual ISP--server plots.