Interactive authoring of outcome-oriented lesson plans for immersive Virtual Reality training

2025-05-03

AI Summary

To address the challenge faced by manufacturing educators—lacking VR development expertise and struggling to design immersive, learning-outcome-driven training content—this paper introduces FlowTrainer, an LLM-powered, educator-centered VR lesson authoring framework. Grounded in backward design theory and domain-specific welding knowledge modeling, FlowTrainer enables non-technical users to specify competency objectives via natural language and automatically aligns instructional activities with assessment tasks. Its key innovation is the first-of-its-kind automated ternary mapping mechanism among *Objectives–Activities–Assessments*, supporting lightweight, visual editing. In empirical welding training deployment, FlowTrainer reduced lesson development time by 62% and substantially lowered technical dependency. Expert users achieved 100% success in generating VR lesson plans compliant with competency standards, demonstrating the feasibility of scaling outcome-oriented VR instruction in industrial education.

Technology Category

• Computer Vision: Motion & Tracking
• Humans and AI: Game Design — Virtual Humans, NPCs and Autonomous Characters
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Search and Retrieval-Augmented AI: Search Tool Learning with LLM: Teaching LLMs to invoke search and make use of retrieved information
• Systems and Infrastructure for Web, Mobile and WoT: Virtualization and resource management in Web systems and infrastructures

Abstract

Immersive Virtual Reality (iVR) applications have shown immense potential for skill training and learning in manufacturing. However, authoring of such applications requires technical expertise, which makes it difficult for educators to author instructions targeted at desired learning outcomes. We present FlowTrainer, an LLM-assisted interactive system to allow educators to author lesson plans for their iVR instruction based on desired goals. The authoring workflow is supported by Backward design to align the planned lesson based on the desired outcomes. We implemented a welding use case and conducted a user study with welding experts to test the effectiveness of the system in authoring outcome-oriented lesson plans. The study results showed that the system allowed users to plan lesson plans based on desired outcomes while reducing the time and technical expertise required for the authoring process. We believe that such efforts can allow widespread adoption of iVR solutions in manufacturing training to meet the workforce demands in the industry.

Problem

• Simplifying iVR lesson plan authoring for educators
• Aligning lesson plans with desired learning outcomes
• Reducing time and technical expertise in iVR training creation

Innovation

• LLM-assisted interactive system for iVR lesson authoring
• Backward design aligns lessons with desired outcomes
• Reduces time and expertise for iVR content creation