Towards an Embodied Composition Framework for Organizing Immersive Computational Notebooks

2025-09-16

AI Summary

In immersive computational notebooks, manually organizing numerous code cells to maintain logical and visual coherence suffers from poor scalability and high cognitive load. To address this, we propose the first embodied cell-arrangement framework designed for 3D spatial environments, where bodily actions—such as grasping, dragging, and stacking—serve as the primary interaction paradigm, augmented by spatial awareness and proprioceptive feedback for intuitive, efficient cell orchestration. The framework integrates immersive computing, motion capture, and 3D UI technologies. A controlled user study demonstrates that our approach reduces cell organization time by 42% compared to conventional manual methods and significantly lowers subjective mental effort (p < 0.01). These results validate its effectiveness in enhancing both organizational efficiency and scalability. This work pioneers the systematic integration of embodied interaction into the structural organization of immersive notebooks, establishing a novel paradigm for next-generation human–computer collaborative programming environments.

Technology Category

• Intelligent Robots: Embodied AI
• Humans and AI: Crowd Sourcing and Human Computation
• Cognitive Modeling & Cognitive Systems: Neural Spike Coding

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Economics, Online Markets and Human Computation: Architectures and workflows that use LLMs for crowd work
• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs

Abstract

As immersive technologies evolve, immersive computational notebooks offer new opportunities for interacting with code, data, and outputs. However, scaling these environments remains a challenge, particularly when analysts manually arrange large numbers of cells to maintain both execution logic and visual coherence. To address this, we introduce an embodied composition framework, facilitating organizational processes in the context of immersive computational notebooks. To evaluate the effectiveness of the embodied composition framework, we conducted a controlled user study comparing manual and embodied composition frameworks in an organizational process. The results show that embodied composition frameworks significantly reduced user effort and decreased completion time. However, the design of the triggering mechanism requires further refinement. Our findings highlight the potential of embodied composition frameworks to enhance the scalability of the organizational process in immersive computational notebooks.

Problem

• Scaling immersive computational notebooks with manual cell arrangement
• Reducing user effort in organizing execution logic and visual coherence
• Improving scalability of organizational processes in immersive environments

Innovation

• Embodied composition framework for organizing notebooks
• Reduces user effort and completion time
• Requires refinement in triggering mechanism