Enabling Seamless Creation of Annotated Spaces: Enhancing Learning in VR Environments

2025-02-21

AI Summary

This study addresses two key challenges in VR-based learning: (1) difficulties in asynchronous teacher–student collaboration and (2) unclear efficacy of annotation mechanisms. To resolve these, we designed a hybrid physical–virtual annotation-enabled VR learning environment: instructors asynchronously create text and handwritten annotations via an 86-inch multi-touch display, while students engage with annotated content immersively in Unity3D VR. We introduce the first educator–learner dual-perspective asynchronous annotation paradigm and propose methods for static-scene annotation transfer and VR interaction adaptation. A mixed-method user study (N=24) integrating System Usability Scale (SUS) assessment and learning outcome measurements demonstrates that annotations significantly improve information retention and comprehension (p<0.01). Annotations are rated highly usable in VR (4.6/5), whereas touch-display intuitiveness remains suboptimal (SUS=52). Our work establishes a novel paradigm and reusable technical framework for asynchronous collaborative annotation in VR education.

Technology Category

• Computer Vision: Video Understanding & Activity Analysis
• Cognitive Modeling & Cognitive Systems: Analogy
• Humans and AI: Game Design — Virtual Humans, NPCs and Autonomous Characters

Application Category

• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Economics, Online Markets and Human Computation: Humans versus LLMs for data annotation and labeling
• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience

Abstract

We present an approach to evaluate the efficacy of annotations in augmenting learning environments in the context of Virtual Reality. Our study extends previous work highlighting the benefits of learning based in virtual reality and introduces a method to facilitate asynchronous collaboration between educators and students. These two distinct perspectives fulfill special roles: educators aim to convey information, which learners should get familiarized. Educators are empowered to annotate static scenes on large touchscreens to supplement information. Subsequently, learners explore those annotated scenes in virtual reality. To assess the comparative ease and usability of creating text and pen annotations, we conducted a user study with 24 participants, which assumed both roles of learners and teachers. Educators annotated static courses using provided textbook excerpts, interfacing through an 86-inch touchscreen. Learners navigated pre-designed educational courses in virtual reality to evaluate the practicality of annotations. The utility of annotations in virtual reality garnered high ratings. Users encountered issues with the touch interface implementation and rated it with a low intuitivity. Despite this, our study underscores the significant benefits of annotations, particularly for learners. This research offers valuable insights into annotation-enriched learning, emphasizing its potential to enhance students' information retention and comprehension.

Problem

• Evaluate annotations in VR learning
• Facilitate educator-student asynchronous collaboration
• Assess usability of text and pen annotations

Innovation

• VR annotation for learning
• Touchscreen educator annotations
• Asynchronous VR collaboration