PolyDebate: A Game-Orchestrated Multimodal System for Debate Skills Practice and Evaluation

📅 2026-08-17
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the lack of multimodal support in existing AI debate systems by developing an English debate training platform that integrates gamified scaffolding with 3D interaction. Leveraging AI opponents, skill cards, and multimodal perception technologies, the system facilitates phased guidance and delivers structured feedback grounded in vocal and visual evidence. Four empirical studies validated the quality of AI opponents, assessment coverage, and feedback efficacy. Results demonstrate that the system significantly enhances immersive debate skill acquisition, establishing a novel practical paradigm and providing technical validation for multimodal intelligent educational applications.
📝 Abstract
Debate is a structured form of persuasive communication that trains argument construction, rebuttal, oral delivery, and audience awareness. These skills are valued in education, language learning, and professional communication. Recent AI debate systems and LLM-based judges have advanced argument generation and debate evaluation, but most remain text-centered and rarely support learners through a complete multimodal practice experience. We introduce PolyDebate, a game-orchestrated multimodal system for English debate practice and evaluation. PolyDebate guides learners through staged one-on-one (1v1) debates with an AI opponent, while skill cards, props, and coins make persuasive strategies explicit and turn practice into a game-like interaction. During each session, the system captures learner speech and visual delivery evidence, generates context-aware opponent responses, and produces rubric-informed stage-level and overall feedback. PolyDebate is available as both an immersive Unity 3D game version and a web platform version that share the same workflow and evaluation services. Four studies covering AI opponent quality, evaluation coverage, AI judge feedback, and user perception show that PolyDebate brings debate interaction, gamified scaffolding, multimodal assessment, and structured feedback together in a practical workflow for debate skills practice. The demonstration video is available at https://youtu.be/mHwBG1_8Ebk.
Problem

Research questions and friction points this paper is trying to address.

Debate Skills Practice
Multimodal Assessment
AI Debate Systems
English Debate
Gamified Learning
Innovation

Methods, ideas, or system contributions that make the work stand out.

Multimodal Assessment
Game-Orchestrated Learning
Debate Scaffolding
Context-Aware Feedback
Cross-Platform Architecture
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
Jianing Yin
Jianing Yin
University of Pennsylvania & Tsinghua University
Human-computer interactionMixed Reality
W
Weng Pan Kuan
Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR, China
X
Xiaoyun Liu
Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR, China
Zhiyuan Wen
Zhiyuan Wen
The Hong Kong Polytechnic University
NLP
Y
Yuxuan Li
Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR, China
Milos Stojmenovic
Milos Stojmenovic
Department of Computer Science and Electrical Engineering, Singidunum University, Belgrade, Serbia
Jiannong Cao
Jiannong Cao
IEEE Fellow; Chair Professor, Hong Kong Polytechnic University
Distributed computingMobile and pervasive computingWireless sensor networksCloud computingBig Data