VTuber's Atelier: The Design Space, Challenges, and Opportunities for VTubing

2025-03-02

AI Summary

Prior VTubing research has predominantly focused on sociocultural aspects, overlooking practical production challenges. Method: We conducted a mixed-methods study comprising a large-scale survey and in-depth interviews with 16 professional VTubers to systematically characterize the end-to-end VTuber creation workflow. Contribution/Results: We propose the first six-dimensional design space—covering hardware setup, rigging, motion driving, lip-sync, facial expression control, and collaborative authoring—grounded in empirical evidence. Our analysis identifies seven core technical and workflow challenges (e.g., motion latency compensation, inefficient micro-expression tuning, and disruptive multi-software switching), revealing how fragmented toolchains impose substantial multitasking overhead and elicit ad hoc workarounds. From these findings, we distill twelve actionable design opportunities centered on usability, collaboration, and automation. This work establishes an empirically grounded, systematic framework to guide the development of next-generation VTuber authoring tools.

Technology Category

• Humans and AI: Game Design — Virtual Humans, NPCs and Autonomous Characters
• Computer Vision: Computational Photography, Image & Video Synthesis
• Cognitive Modeling & Cognitive Systems: Computational Creativity

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Systems and Infrastructure for Web, Mobile and WoT: Virtualization and resource management in Web systems and infrastructures
• Economics, Online Markets and Human Computation: LLM based quality controls for crowd work

Abstract

VTubing, the practice of live streaming using virtual avatars, has gained worldwide popularity among streamers seeking to maintain anonymity. While previous research has primarily focused on the social and cultural aspects of VTubing, there is a noticeable lack of studies examining the practical challenges VTubers face in creating and operating their avatars. To address this gap, we surveyed VTubers' equipment and expanded the live-streaming design space by introducing six new dimensions related to avatar creation and control. Additionally, we conducted interviews with 16 professional VTubers to comprehensively explore their practices, strategies, and challenges throughout the VTubing process. Our findings reveal that VTubers face significant burdens compared to real-person streamers due to fragmented tools and the multi-tasking nature of VTubing, leading to unique workarounds. Finally, we summarize these challenges and propose design opportunities to improve the effectiveness and efficiency of VTubing.

Problem

• Explores practical challenges in VTuber avatar creation and operation.
• Identifies fragmented tools and multitasking burdens for VTubers.
• Proposes design opportunities to enhance VTubing efficiency and effectiveness.

Innovation

• Surveyed VTubers' equipment for insights
• Introduced six new avatar control dimensions
• Proposed design improvements for VTubing efficiency