Vitessce Link: A Mixed Reality and 2D Display Hybrid Approach for Visual Analysis of 3D Tissue Maps
🤖 AI Summary
Current tools lack intuitive, interactive spatial analysis capabilities for 3D tissue atlas data—largely restricted to 2D visualization and deficient in stereoscopic rendering and integrated analytical functionality. To address this, we introduce a web-native WebXR framework that enables seamless coordination between browser-based 3D stereoscopic visualization and a 2D analytical interface (built on Vitessce) for the first time. The framework supports gesture-based navigation, synchronized multi-view exploration, and cross-device real-time collaboration via lightweight WebSocket communication. It is compatible with computational environments such as Jupyter and adheres to open web standards, ensuring extensibility and interoperability. Validation in nephrology and oncology use cases demonstrates substantial improvements in accuracy and intuitiveness for spatial cell relationship interpretation, structural segmentation assessment, and multidimensional distance quantification. This work establishes a new, scalable, interactive paradigm for 3D spatial omics analysis.
Application Category
📝 Abstract
Advances in spatial omics and high-resolution imaging enable the creation of three-dimensional (3D) tissue maps that capture cellular organization and interactions in situ. While these data provide critical insights into tissue function and disease, their exploration is often constrained by tools limited to 2D displays or stereoscopic rendering without analytical integration. We present Vitessce Link, a web-based hybrid framework that unites a 3D stereoscopic view in mixed reality with a synchronized 2D display environment. Users can navigate volumetric data with intuitive hand gestures while controlling channels, filters, and derived data views through the Vitessce platform. Built on open standards and running entirely in the browser, Vitessce Link minimizes friction, supports integration with computational notebooks, and synchronizes interactions across devices via a lightweight WebSocket architecture. Case studies in nephrology and oncology demonstrate how the hybrid approach enhances segmentation evaluation, distance measurement, and interpretation of spatial relationships. Vitessce Link establishes a paradigm for integrative, web-native analysis of 3D tissue maps.
Problem
Research questions and friction points this paper is trying to address.
Enables 3D tissue map analysis beyond 2D display limitations
Integrates mixed reality visualization with analytical tool synchronization
Facilitates intuitive spatial exploration of cellular organization in situ
Innovation
Methods, ideas, or system contributions that make the work stand out.
Hybrid framework combining mixed reality with 2D display
Browser-based system using open standards and WebSocket synchronization
Enables gesture navigation and synchronized analytical controls
🔎 Similar Papers
No similar papers found.
