ChildGaze: A Benchmark Dataset for Collaborative Behavior Understanding in Children

2026-09-06

AI Summary

为了解决儿童协作行为理解的问题，研究引入了ChildGaze数据集，通过视频标注区分协作与非协作行为，并利用预训练模型进行验证。

Abstract

Understanding collaborative behavior in children is important for analyzing social participation, peer interaction, shared attention, and engagement during play and learning activities. Reliable recognition of these cues can support research in child development, educational analysis, and human-centered computer vision. However, estimating where a child is looking does not necessarily reveal whether the child is actively participating in a shared activity. To support this higher-level analysis, we introduce ChildGaze, a child-centered behavioral annotation dataset built on the ChildPlay video collection [1]. ChildGaze introduces two behavioral labels, collaborative and non-collaborative, assigned independently to each child within a frame. The dataset provides face, left-hand, and right-hand bounding boxes for children and adults and organizes the annotations at the row, person, and frame levels. The current release contains 27 annotated video files, 10,641 frames, and 73,268 body-part annotation rows. Annotation reliability was evaluated on 1,187 frames using independent annotations from two annotators. The collaboration labels achieved 93.16% raw agreement and a Cohen's kappa of 0.8631, while bounding-box annotations achieved an overall mean IoU of 0.808. Baseline experiments with pretrained ViT and Swin Transformer models achieved up to 97.44% child-person-level accuracy and 96.80% frame-level accuracy, respectively. These results show that ChildGaze provides a reliable benchmark for studying collaborative behavior in naturalistic child-adult and peer interactions.

Problem

• Collaborative Behavior
• Child Development
• Social Participation
• Peer Interaction
• Shared Attention

Innovation

• ChildGaze
• Collaborative Behavior
• Behavioral Annotation
• Naturalistic Interaction
• Benchmark Dataset