On the development of an AI performance and behavioural measures for teaching and classroom management

📅 2025-06-11
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
To address subjectivity, high labor costs, and insufficient cultural adaptation in classroom observation, this study develops the first multimodal AI behavioral analysis system tailored for Asian classrooms. Methodologically, it integrates audio, video, and environmental sensor data; proposes a culturally adaptive educational AI analytics framework; designs a scoring-free, feedback-oriented instructional reflection dashboard; and establishes the first publicly available audiovisual annotation dataset of Asian classroom interactions. Key contributions include: (1) introducing interpretable, behavior-based classroom metrics; (2) achieving real-time behavioral recognition with low cognitive load and high usability—validated by eight experts from Singapore’s National Institute of Education; and (3) significantly reducing human effort required for classroom observation. The system provides teachers with objective, scalable, and context-sensitive technological support for professional development.

Technology Category

Application Category

📝 Abstract
This paper presents a two-year research project focused on developing AI-driven measures to analyze classroom dynamics, with particular emphasis on teacher actions captured through multimodal sensor data. We applied real-time data from classroom sensors and AI techniques to extract meaningful insights and support teacher development. Key outcomes include a curated audio-visual dataset, novel behavioral measures, and a proof-of-concept teaching review dashboard. An initial evaluation with eight researchers from the National Institute for Education (NIE) highlighted the system's clarity, usability, and its non-judgmental, automated analysis approach -- which reduces manual workloads and encourages constructive reflection. Although the current version does not assign performance ratings, it provides an objective snapshot of in-class interactions, helping teachers recognize and improve their instructional strategies. Designed and tested in an Asian educational context, this work also contributes a culturally grounded methodology to the growing field of AI-based educational analytics.
Problem

Research questions and friction points this paper is trying to address.

Develop AI measures to analyze classroom dynamics
Extract insights from multimodal sensor data for teaching
Provide automated analysis to reduce manual workloads
Innovation

Methods, ideas, or system contributions that make the work stand out.

AI-driven measures analyze classroom dynamics
Multimodal sensor data captures teacher actions
Automated dashboard provides objective interaction snapshots
🔎 Similar Papers
No similar papers found.
A
Andreea Niculescu
A*STAR Inst. for Infocomm Research, Singapore
J
Jochen Ehnen
A*STAR Inst. for Infocomm Research, Singapore
C
Chen Yi
A*STAR Inst. High Perf. Computing, Singapore
Jiawei Du
Jiawei Du
National Taiwan University; ex-Intern @ Samsung Research
Speech processingNeural codingGenerative AIAI security
T
Tay Chiat Pin
A*STAR Inst. High Perf. Computing, Singapore
Joey Tianyi Zhou
Joey Tianyi Zhou
A*STAR and NUS
Efficient AIRobust & Safe AI
Vigneshwaran Subbaraju
Vigneshwaran Subbaraju
Agency for Science Technology and Research (A*STAR)
Multi-modal interactionLifelog analysisAmbient/Wearable Sensor analyticsMRI analysisNeural networks
T
Teh Kah Kuan
A*STAR Inst. for Infocomm Research, Singapore
T
Tran Huy Dat
A*STAR Inst. for Infocomm Research, Singapore
John Komar
John Komar
Nanyang Technological University
ExpertiseMotor learningNonlinear PedagogySports Analytics
G
Gi Soong Chee
National Institute of Education NTU, Singapore
Kenneth Kwok
Kenneth Kwok
Institute of High Performance Computing
Cognitive ScienceArtificial IntelligenceCommonsense Reasoning