Personalized Education with Generative AI and Digital Twins: VR, RAG, and Zero-Shot Sentiment Analysis for Industry 4.0 Workforce Development

2025-02-19

AI Summary

Under Industry 4.0, marginalized groups—such as ethnic minorities—face reskilling barriers due to inequitable access to high-quality educational resources. Method: This study proposes gAI-PT4I4, a personalized education system featuring a novel multi-fidelity digital twin (DT) pedagogical model. It is the first to integrate Bloom’s taxonomy and the Kirkpatrick evaluation framework into a DT architecture. The system synergistically combines generative AI (large language models), zero-shot sentiment analysis (86% accuracy), retrieval-augmented generation (RAG), and finite-state machines to enable unlabeled, real-time learner state recognition, dynamic difficulty adaptation, and competency-driven knowledge delivery (targeting ≥80% task completion). Low-fidelity DTs and VR-based training further enhance accessibility. Results: A 22-participant pilot demonstrated >80% training accuracy and significantly reduced training duration, validating the system’s efficacy in equitable, adaptive upskilling.

Technology Category

• Humans and AI: AI for Accessibility
• Machine Learning: Multimodal Learning
• Cognitive Modeling & Cognitive Systems: Adaptive Behavior

Application Category

• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization
• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking

Abstract

The Fourth Industrial Revolution (4IR) technologies, such as cloud computing, machine learning, and AI, have improved productivity but introduced challenges in workforce training and reskilling. This is critical given existing workforce shortages, especially in marginalized communities like Underrepresented Minorities (URM), who often lack access to quality education. Addressing these challenges, this research presents gAI-PT4I4, a Generative AI-based Personalized Tutor for Industrial 4.0, designed to personalize 4IR experiential learning. gAI-PT4I4 employs sentiment analysis to assess student comprehension, leveraging generative AI and finite automaton to tailor learning experiences. The framework integrates low-fidelity Digital Twins for VR-based training, featuring an Interactive Tutor - a generative AI assistant providing real-time guidance via audio and text. It uses zero-shot sentiment analysis with LLMs and prompt engineering, achieving 86% accuracy in classifying student-teacher interactions as positive or negative. Additionally, retrieval-augmented generation (RAG) enables personalized learning content grounded in domain-specific knowledge. To adapt training dynamically, finite automaton structures exercises into states of increasing difficulty, requiring 80% task-performance accuracy for progression. Experimental evaluation with 22 volunteers showed improved accuracy exceeding 80%, reducing training time. Finally, this paper introduces a Multi-Fidelity Digital Twin model, aligning Digital Twin complexity with Bloom's Taxonomy and Kirkpatrick's model, providing a scalable educational framework.

Problem

• Address workforce training challenges in Industry 4.0.
• Personalize learning for marginalized communities using Generative AI.
• Enhance VR-based training with real-time sentiment analysis.

Innovation

• Generative AI for personalized tutoring
• Zero-shot sentiment analysis with LLMs
• Multi-Fidelity Digital Twin model