Brief but Impactful: How Human Tutoring Interactions Shape Engagement in Online Learning

2026-01-15

AI Summary

This study investigates how brief human tutoring interventions can effectively enhance student engagement in online learning, particularly in motivational dimensions less accessible to AI. Leveraging 2,075 hours of middle school mathematics instruction, the research integrates Zoom tutoring transcripts, MATHia system logs, and mixed-effects modeling to develop a multimodal learning analytics framework. Findings reveal that human tutoring exerts both immediate and sustained effects on engagement, with diminishing marginal returns over time yet greater immediate gains from later interventions. Tutoring characterized by concreteness, step-by-step guidance, and clear task framing proves most effective in stimulating participation. Based on these insights, the study proposes an efficient tutoring strategy—frequent, brief sessions, well-timed, with at least one early interaction—and introduces an analytical tool capable of real-time identification of high-impact tutoring behaviors.

Technology Category

• Machine Learning: Online Learning & Bandits
• Humans and AI: Learning Human Values and Preferences
• Cognitive Modeling & Cognitive Systems: Simulating Human Behavior

Application Category

• Economics, Online Markets and Human Computation: Humans versus LLMs for data annotation and labeling
• User Modeling, Personalization and Recommendation: Studies of user behavior, including longitudinal effects of personalized systems
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking

Abstract

Learning analytics can guide human tutors to efficiently address motivational barriers to learning that AI systems struggle to support. Students become more engaged when they receive human attention. However, what occurs during short interventions, and when are they most effective? We align student-tutor dialogue transcripts with MATHia tutoring system log data to study brief human-tutor interactions on Zoom drawn from 2,075 hours of 191 middle school students'classroom math practice. Mixed-effect models reveal that engagement, measured as successful solution steps per minute, is higher during a human-tutor visit and remains elevated afterward. Visit length exhibits diminishing returns: engagement rises during and shortly after visits, irrespective of visit length. Timing also matters: later visits yield larger immediate lifts than earlier ones, though an early visit remains important to counteract engagement decline. We create analytics that identify which tutor-student dialogues raise engagement the most. Qualitative analysis reveals that interactions with concrete, stepwise scaffolding with explicit work organization elevate engagement most strongly. We discuss implications for resource-constrained tutoring, prioritizing several brief, well-timed check-ins by a human tutor while ensuring at least one early contact. Our analytics can guide the prioritization of students for support and surface effective tutor moves in real-time.

Problem

• human tutoring
• student engagement
• online learning
• motivational barriers
• learning analytics

Innovation

• learning analytics
• human tutoring
• engagement
• scaffolding
• mixed-effect models