Navigating the Ethics of Internet Measurement: Researchers'Perspectives from a Case Study in the EU

2025-11-13

AI Summary

Internet measurement research confronts pressing ethical challenges—including privacy risks, informed consent complexities, potential participant harm, and misalignment between conventional ethics review frameworks and technical practice—yet scholarly understanding of researchers’ lived ethical decision-making remains limited. This study employs thematic analysis of in-depth interviews with 16 internet measurement researchers across the EU, grounded in a case-study framework. It identifies five recurrent ethical challenge categories and corresponding mitigation strategies, and introduces the novel concept of “ethical craft knowledge,” highlighting the central role of mentorship and peer collaboration in cultivating situated ethical practice. Findings reveal that institutional review boards frequently lack technical literacy regarding measurement methodologies, while cross-institutional and cross-jurisdictional regulatory fragmentation imposes substantial invisible labor. The study calls for a discipline-specific, technically informed ethics support infrastructure tailored to the epistemic and operational realities of internet measurement.

Technology Category

• Machine Learning: Ethics, Bias, and Fairness
• Natural Language Processing: Ethics — Bias, Fairness, Transparency & Privacy
• Philosophy and Ethics of AI: Privacy & Security

Application Category

• Responsible Web: Measurement, analysis, and circumvention of Web censorship
• Web Mining and Content Analysis: Web measurements
• Security and Privacy: Large-scale security measurements

Abstract

Internet measurement research is essential for understanding, improving, and securing Internet infrastructure. However, its methods often involve large-scale data collection and user observation, raising complex ethical questions. While recent research has identified ethical challenges in Internet measurement research and laid out best practices, little is known about how researchers actually make ethical decisions in their research practice. To understand how these practices take shape day-to-day from the perspective of Internet measurement researchers, we interviewed 16 researchers from an Internet measurement research group in the EU. Through thematic analysis, we find that researchers deal with five main ethical challenges: privacy and consent issues, the possibility of unintended harm, balancing transparency with security and accountability, uncertain ethical boundaries, and hurdles in the ethics review process. Researchers address these by lab testing, rate limiting, setting up clear communication channels, and relying heavily on mentors and colleagues for guidance. Researchers express that ethical requirements vary across institutions, jurisdictions and conferences, and ethics review boards often lack the technical knowledge to evaluate Internet measurement research. We also highlight the invisible labor of Internet measurement researchers and describe their ethics practices as craft knowledge, both of which are crucial in upholding responsible research practices in the Internet measurement community.

Problem

• Researchers face complex ethical dilemmas in large-scale internet data collection
• Ethical decision-making practices lack understanding in internet measurement research
• Institutional ethics boards often lack technical expertise for proper evaluation

Innovation

• Lab testing to address ethical challenges
• Rate limiting for responsible data collection
• Clear communication channels for transparency