EXR: An Interactive Immersive EHR Visualization in Extended Reality

2025-12-05

AI Summary

This study addresses key limitations of conventional 2D electronic health record (EHR) interfaces—namely, poor interactivity, lack of spatial context, and low clinical collaboration efficiency. To this end, we propose an immersive EHR visualization framework leveraging extended reality (XR). Our modular architecture integrates FHIR-standardized structured EHR data, CT volumetric datasets, and AI-generated medical image segmentation outputs, enabling spatial mapping, real-time rendering, and natural interaction with multimodal patient data within a shared 3D environment. The platform ensures cross-system interoperability and demonstrates feasibility using synthetic EHR data and AI-reconstructed 3D spinal models. To our knowledge, this is the first work to deeply integrate FHIR, AI-driven segmentation, and XR technologies, establishing a novel paradigm for collaborative, explorable, and extensible clinical data interaction. The framework lays critical technical foundations for next-generation immersive clinical decision support systems.

Technology Category

• Humans and AI: Explainable AI (XAI) for Human Understanding
• Computer Vision: Multi-modal Vision
• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Web applications in cross-disciplinary domains and verticals such as mixed reality, smart cities, and digital health
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

This paper presents the design and implementation of an Extended Reality (XR) platform for immersive, interactive visualization of Electronic Health Records (EHRs). The system extends beyond conventional 2D interfaces by visualizing both structured and unstructured patient data into a shared 3D environment, enabling intuitive exploration and real-time collaboration. The modular infrastructure integrates FHIR-based EHR data with volumetric medical imaging and AI-generated segmentation, ensuring interoperability with modern healthcare systems. The platform's capabilities are demonstrated using synthetic EHR datasets and computed tomography (CT)-derived spine models processed through an AI-powered segmentation pipeline. This work suggests that such integrated XR solutions could form the foundation for next-generation clinical decision-support tools, where advanced data infrastructures are directly accessible in an interactive and spatially rich environment.

Problem

• Designing an XR platform for immersive EHR visualization
• Integrating structured and unstructured patient data into a 3D environment
• Enabling real-time collaboration and intuitive data exploration

Innovation

• Extended Reality platform for immersive EHR visualization
• Integrates FHIR data with volumetric imaging and AI segmentation
• Enables interactive exploration and real-time collaboration in 3D