🤖 AI Summary
This work addresses the unreliability of vision-language models in reasoning about compositional spatial relationships that depend on reference frames. To tackle this challenge, the authors propose SATURN, a neuro-symbolic framework that decouples perception from reasoning by reconstructing an approximate 3D scene, incorporating viewpoint-aware soft spatial predicates, and leveraging a training-free Pythonic symbolic executor to propagate multi-hop uncertainties. By integrating 3D geometric understanding, soft predicate modeling, and symbolic reasoning, SATURN achieves robust performance on the 3D FORCE benchmark and attains 78.57% accuracy on the real-world MindCube benchmark—outperforming the strongest baseline by 14 percentage points.
📝 Abstract
Vision-Language Models (VLMs) remain unreliable when spatial reasoning requires composing relations whose meanings depend on frames of reference. Existing neuro-symbolic methods make reasoning more explicit, but often depend on brittle geometric procedures and hard decisions over noisy perception. We propose SATURN, a neuro-symbolic framework for perspective-aware compositional spatial reasoning. SATURN reconstructs an approximate 3D scene, derives soft perspective-aware spatial predicates, and composes them with a training-free Pythonic symbolic executor, separating perception from reasoning while preserving uncertainty through multi-hop inference. We also introduce 3D FORCE, a diagnostic benchmark that controls reasoning depth, view, and perspective composition across spatial arrangement grounding (SAG) and referring expression grounding (REF). On 3D FORCE, VLMs and spatially trained models degrade sharply as depth and perspective complexity increase, whereas SATURN remains stable and outperforms strong baselines. On the real-world MindCube benchmark, SATURN achieves 78.57% overall accuracy, outperforming the strongest baseline by 14 pp.