Does the Doer Effect Exist Beyond WEIRD Populations? Toward Analytics in Radio and Phone-Based Learning

2024-12-30

AI Summary

This study investigates the universality and boundary conditions of the “Doer Effect” in a non-WEIRD population—234 students in remote Uganda. Addressing the gap in low-resource, distance-learning contexts, it integrates mobile-based response logs, radio-listening tracking, and academic performance data. Using regression modeling and hierarchical effect analysis, the study compares active learning (mobile interactive quiz-taking) against passive learning (community radio instruction). Results demonstrate that active learning significantly improves academic outcomes; however, this effect attenuates with higher prior educational attainment—providing the first empirical validation of a moderating mechanism for the Doer Effect in resource-constrained remote education. The study innovatively proposes context-sensitive design principles—including lightweight technological adaptation and alignment of multi-source behavioral data—thereby offering critical empirical evidence and theoretical refinement for EdTech interventions in the Global South.

Technology Category

• Machine Learning: Active Learning
• Reasoning under Uncertainty: Causality
• Search and Optimization: Learning to Search

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Responsible Web: Data and user privacy-enhancing technologies for the Web

Abstract

The Doer Effect states that completing more active learning activities, like practice questions, is more strongly related to positive learning outcomes than passive learning activities, like reading, watching, or listening to course materials. Although broad, most evidence has emerged from practice with tutoring systems in Western, Industrialized, Rich, Educated, and Democratic (WEIRD) populations in North America and Europe. Does the Doer Effect generalize beyond WEIRD populations, where learners may practice in remote locales through different technologies? Through learning analytics, we provide evidence from N = 234 Ugandan students answering multiple-choice questions via phones and listening to lectures via community radio. Our findings support the hypothesis that active learning is more associated with learning outcomes than passive learning. We find this relationship is weaker for learners with higher prior educational attainment. Our findings motivate further study of the Doer Effect in diverse populations. We offer considerations for future research in designing and evaluating contextually relevant active and passive learning opportunities including leveraging familiar technology, increasing the number of practice opportunities, and aligning multiple data sources.

Problem

• Cultural Universality
• Educational Methods
• WEIRD Populations

Innovation

• Executor Effect
• Active Learning
• Cross-Cultural Analysis