ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI

2026-07-05

AI Summary

Existing embodied AI systems lack a unified representation and closed-loop mechanism across perception, planning, execution, and self-improvement, hindering the realization of general physical intelligence. This work proposes ACE-Brain-0.5, an embodied foundation model that, for the first time, leverages spatial intelligence as a shared scaffold to integrate five core modules—spatial perception, decision-making, embodied interaction, self-monitoring, and self-improvement—into a cohesive closed-loop architecture. It introduces the SSR+ mechanism, which adds a reactivation phase after task vector fusion to mitigate cross-task interference and enables continuous self-updating of execution states. Built upon an 8B-parameter backbone, the model unifies 3D and egocentric spatial reasoning, task decomposition, action generation, and progress evaluation, augmented with external memory and failure recovery. Evaluated across 15 benchmarks, it surpasses prior models in 14 spatial perception and grounding tasks, demonstrates competitive navigation and manipulation performance, and exhibits robust progress estimation both in- and out-of-distribution.

Abstract

Embodied AI is moving from isolated perception or action modules toward physical agents that understand, plan under goals, act through robot bodies, monitor progress, and improve from experience. Existing systems address this loop only in parts: end-to-end policies generate actions but often lack spatial reasoning, planning, and execution assessment, while robot-agent systems orchestrate tools or specialists but do not learn a shared representation. This fragmentation limits general Physical Agentic AI. We present ACE-Brain-0.5, a unified embodied foundation model that organizes robot intelligence into five coupled functions: spatial perception, decision making, embodied interaction, self-monitoring, and self-improvement. Built on ACE-Brain-0, which established spatial intelligence as a shared scaffold across robot platforms, ACE-Brain-0.5 extends an understanding-centric model into a closed-loop foundation model. A single 8B backbone instantiates the first four functions: grounding objects and affordances, reasoning over 3D and egocentric spatial relations, decomposing instructions into subgoals, generating navigation and manipulation actions, and estimating progress for verification and recovery. To unify these capabilities without cross-task interference, we introduce SSR+, which extends Scaffold-Specialize-Reconcile with a Reactivate stage after task-vector merging. The fifth function, self-improvement, is realized by a companion framework that updates external execution state, including task schemas, spatial memory, and failure-recovery cases, from rollouts. Across fifteen benchmarks, ACE-Brain-0.5 improves over ACE-Brain-0 on 14 of 18 spatial perception and grounding benchmarks, achieves competitive navigation and manipulation performance, and provides strong progress estimation in ID and OOD settings. Together, these results mark an early step toward general Physical Agentic AI.

Problem

• Embodied AI
• Physical Agentic AI
• Spatial Reasoning
• Unified Representation
• Agent Loop

Innovation

• embodied foundation model
• spatial intelligence
• SSR+
• self-improvement
• physical agentic AI