unreal engine

Existing code-generating agents lack effective evaluation benchmarks within real-world, stateful, real-time C++ systems such as game engines. This work proposes the first evaluation platform built on Unreal Engine 5, comprising 110 C++ tasks extracted from nine real game repositories, spanning critical dimensions including game logic, networking, AI, and rendering. The framework employs behavior-driven testing and a multi-dimensional categorization scheme to automatically assess models via pass@1, measuring their ability to generate correct, compilable code within executable projects. Experimental results show that the best-performing model achieves a pass@1 rate of 55.5%, yet 31 tasks remain unsolved, highlighting significant challenges faced by current agents in deeply integrated development within complex C++ systems.

This work addresses the longstanding challenge in scientific visualization of balancing rendering performance with visual fidelity for large-scale 3D datasets, compounded by the high barrier to entry of conventional tools. The authors present an interactive benchmarking platform built on Unreal Engine that systematically implements and organizes 22 optimization techniques into six cohesive families. These techniques are integrated into the engine’s subsystems, enabling configurable combinations, real-time telemetry, and A/B comparisons. By leveraging mechanisms such as Nanite, multi-level level-of-detail (LOD), and culling algorithms—combined with integrated performance profiling and expert evaluation workflows—the platform demonstrates significant gains in optimization efficiency. Validation on ribosome structures and volumetric flow fields confirms its effectiveness in helping users maintain high visual fidelity under strict performance constraints.

This study systematically evaluates Unreal Engine’s technical potential and practical limitations in immersive narrative and VR applications, identifying key challenges including high hardware requirements, limited accessibility, excessive immersion, and data privacy concerns. Methodologically, it integrates real-time rendering, AI-driven workflows, procedural content generation, and cloud-based collaboration to establish a cross-domain validation framework spanning gaming, virtual production, education, cultural heritage preservation, and medical rehabilitation. The work proposes an innovative paradigm unifying affective storytelling, photorealistic rendering, and adaptive AI—enhanced by cost-effective cloud rendering and embedded ethical design principles to ensure data privacy and sustainability. Empirical results demonstrate significant improvements in interaction depth and deployment flexibility. The framework delivers a reproducible methodology and empirical benchmark for interdisciplinary development of immersive media, advancing both theoretical understanding and practical implementation of ethically grounded, scalable immersive experiences.

VR development lacks quantitative, evidence-based criteria for selecting between Unreal Engine and Unity. Method: This study establishes a multidimensional empirical evaluation framework integrating rendering fidelity, computational efficiency, cross-platform compatibility, workflow productivity, and AI-enhanced capabilities (e.g., DLSS, LLM-assisted debugging), validated through systematic benchmarking and large-scale industrial case studies. Crucially, it pioneers the incorporation of AI-driven optimization techniques into engine performance attribution analysis and proposes a demand-aware, dynamic engine selection model grounded in project characteristics—such as immersion priority, hardware constraints, and team size. Contribution/Results: Findings indicate that high-fidelity VR applications favor Unreal Engine, whereas rapid-iteration or lightweight scenarios benefit more from Unity. The framework reduces selection-related trial-and-error costs by 37% and improves development efficiency by 2.1×, establishing a reusable, data-driven paradigm for engine selection in industrial VR deployment.

This work addresses the “memory wall” bottleneck that limits existing generative game engines from supporting high-resolution real-time neural simulation. The authors propose a hardware-algorithm co-design approach that decouples the compute-intensive world model from the memory-intensive decoder and deploys the system on a programmable AI accelerator cluster. Key innovations include asymmetric resource allocation under a heterogeneous architecture, memory-centric operator fusion, and a manifold-aware latent space extrapolation mechanism. Evaluated on representative benchmarks, the system achieves 26.4 FPS at 720×480 resolution for a 3D racing game and 48.3 FPS for a 2D platformer, delivering a 50× increase in pixel throughput and an end-to-end latency as low as 2.7 ms.

Existing 3D generation methods struggle to simultaneously achieve high visual fidelity, real-time performance, and mobile deployment. This work proposes the first single-image 3D generation framework that balances deployment efficiency and interactive speed, producing high-quality meshes with baked normals, colored textures, and controllable face counts within 30 seconds; its Flash variant delivers preview-quality results in just 14 seconds. The approach integrates coarse-to-fine VecSet-based geometry generation, multi-view texture synthesis, and 3D back-projection inpainting, while performing mesh simplification, cleanup, normal baking, and parallel UV unwrapping directly on the GPU. Combined with model distillation and pipeline parallelism, the system minimizes end-to-end latency. Experiments demonstrate that the generated assets match the visual quality of commercial solutions, with both automated metrics and blind human evaluations confirming the method’s efficiency and practicality.

This work addresses the inability of CUDA and Vulkan to execute compute and graphics tasks concurrently on GPUs due to scheduling isolation, which severely limits hardware utilization. To overcome this limitation, the authors present the first cross-ecosystem spatial sharing solution between CUDA and Vulkan. Their approach introduces driver-level mechanisms—including channel redirection, virtual address space merging, and page table grafting—to unify scheduling and memory address spaces without requiring data copies. A lightweight developer annotation API is also provided to facilitate integration. Evaluated on representative embodied AI workloads, the system achieves up to 85% higher throughput compared to a time-multiplexing baseline, while significantly reducing end-to-end latency and improving overall GPU utilization.

Existing high-fidelity simulators struggle to meet the demands of embodied intelligence research in terms of generality, programmability, and rendering efficiency. To address this gap, this work proposes SPEAR—a Python-based simulation library built on Unreal Engine—that exposes over 14,000 UE functions to Python for the first time, enabling unprecedented procedural control. SPEAR employs a modular plugin architecture and a high-level task graph scheduling model to support deterministic execution of complex tasks, delivering high-definition multimodal images along with accurate annotations to NumPy arrays at an efficient rate of 73 FPS. The system has been successfully applied to diverse tasks including agent control, city-scale rendering, multi-view facial imaging, physics-informed co-simulation, and language-driven scene editing, significantly enhancing both simulation efficiency and functional coverage.

Developing GPU kernels in Rust presents a significant challenge in simultaneously achieving high performance and memory safety. This work proposes cuTile Rust, the first system to enforce Rust’s ownership semantics within GPU kernels. By introducing a tiled kernel design coupled with a novel ownership separation mechanism, cuTile Rust enables safe, idiomatic low-level control while unifying diverse execution models—including synchronous launches, asynchronous pipelining, and CUDA Graph replay. Evaluated on NVIDIA B200 hardware, the system attains 7 TB/s element-wise memory bandwidth and 2 PFlop/s GEMM performance, reaching 96% of cuBLAS throughput. Furthermore, the Grout inference engine built atop cuTile Rust achieves 171 and 82 tokens/s on Qwen3-4B and Qwen3-32B models, respectively, matching the performance of state-of-the-art frameworks such as vLLM and SGLang.