90% Faster, 100% Code-Free: MLLM-Driven Zero-Code 3D Game Development

2025-09-30

AI Summary

3D game development remains prohibitively high-barrier due to its reliance on programming, 3D modeling, and engine-specific configuration. Existing automated approaches are limited to 2D content, require manual integration, struggle with interactive logic and state management, and lack end-to-end support for mainstream engines (e.g., Unity, Unreal). Method: We propose the first zero-code, multi-agent collaborative framework for 3D game generation, leveraging multimodal large language models to orchestrate specialized agents for planning, code generation, automation, and debugging—enabling full pipeline translation from natural language specifications to executable C#-based Unity/Unreal projects. Contribution/Results: Evaluated on three prototype games, our framework reduces average development time by 91.4% and eliminates hand-written code entirely, marking a significant breakthrough in automating interactive 3D game creation.

Technology Category

• Humans and AI: Game Design — Procedural Content Generation & Storytelling
• Natural Language Processing: Code Generation / Program Synthesis from Natural Language
• Machine Learning: Large Multimodal Models (LMMs)

Application Category

• Economics, Online Markets and Human Computation: Uses of LLMs and GenAI for marketplace design, bidding, and strategic interactions
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Social Networks and Social Media: Generative AI / large language models and their impact on social systems

Abstract

Developing 3D games requires specialized expertise across multiple domains, including programming, 3D modeling, and engine configuration, which limits access to millions of potential creators. Recently, researchers have begun to explore automated game development. However, existing approaches face three primary challenges: (1) limited scope to 2D content generation or isolated code snippets; (2) requirement for manual integration of generated components into game engines; and (3) poor performance on handling interactive game logic and state management. While Multimodal Large Language Models (MLLMs) demonstrate potential capabilities to ease the game generation task, a critical gap still remains in translating these outputs into production-ready, executable game projects based on game engines such as Unity and Unreal Engine. To bridge the gap, this paper introduces UniGen, the first end-to-end coordinated multi-agent framework that automates zero-coding development of runnable 3D games from natural language requirements. Specifically, UniGen uses a Planning Agent that interprets user requirements into structured blueprints and engineered logic descriptions; after which a Generation Agent produces executable C# scripts; then an Automation Agent handles engine-specific component binding and scene construction; and lastly a Debugging Agent provides real-time error correction through conversational interaction. We evaluated UniGen on three distinct game prototypes. Results demonstrate that UniGen not only democratizes game creation by requiring no coding from the user, but also reduces development time by 91.4%. We release UniGen at https://github.com/yxwan123/UniGen. A video demonstration is available at https://www.youtube.com/watch?v=xyJjFfnxUx0.

Problem

• Automating 3D game development without coding expertise
• Translating natural language into executable game engine projects
• Integrating interactive logic and components automatically in engines

Innovation

• Multi-agent framework automates zero-code 3D game development
• Agents interpret requirements into blueprints and scripts
• Automation handles engine binding and real-time debugging