Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators

๐Ÿ“… 2025-09-11
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
To address the clinical deployment bottleneck of 3D photoacoustic computed tomography (PACT)โ€”namely, its reliance on dense sensor arrays and prolonged acquisition timesโ€”this work proposes Pano, an end-to-end physics-informed neural operator. Pano integrates spherical discrete-continuous convolution to preserve sensor geometry, embeds the Helmholtz equation as a hard physical constraint to ensure acoustic consistency, and achieves resolution-agnostic and sparse-sampling generalization. Evaluated on both simulated and experimental data, Pano enables real-time, high-fidelity volumetric 3D reconstruction using only a small number of transducers and limited-view acquisitions, maintaining image quality while substantially reducing hardware cost. Its core contribution lies in the first rigorous unification of first-principles physical modeling with neural operators, enabling high-fidelity, low-sampling-rate, multi-scale inverse acoustic mapping.

Technology Category

Application Category

๐Ÿ“ Abstract
Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit. While three-dimensional PACT systems enable high-resolution volumetric imaging for applications spanning transcranial to breast imaging, current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation. We introduce Pano (PACT imaging neural operator), an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions. Unlike existing approaches (e.g. universal back-projection algorithm), Pano learns both physics and data priors while also being agnostic to the input data resolution. Pano employs spherical discrete-continuous convolutions to preserve hemispherical sensor geometry, incorporates Helmholtz equation constraints to ensure physical consistency and operates resolutionindependently across varying sensor configurations. We demonstrate the robustness and efficiency of Pano in reconstructing high-quality images from both simulated and real experimental data, achieving consistent performance even with significantly reduced transducer counts and limited-angle acquisition configurations. The framework maintains reconstruction fidelity across diverse sparse sampling patterns while enabling real-time volumetric imaging capabilities. This advancement establishes a practical pathway for making 3D PACT more accessible and feasible for both preclinical research and clinical applications, substantially reducing hardware requirements without compromising image reconstruction quality.
Problem

Research questions and friction points this paper is trying to address.

Reducing transducer count and acquisition time in 3D PACT
Learning inverse acoustic mapping from sensor to volumetric data
Maintaining reconstruction quality with sparse sampling configurations
Innovation

Methods, ideas, or system contributions that make the work stand out.

End-to-end physics-aware neural operator model
Spherical discrete-continuous convolution operations
Helmholtz equation constraints for physical consistency
๐Ÿ”Ž Similar Papers
No similar papers found.
J
Jiayun Wang
Department of Computing and Mathematical Sciences, California Institute of Technology, 1200 E California Blvd, Pasadena, 91125, CA, United States.
Yousuf Aborahama
Yousuf Aborahama
Caltech
Medical ImagingPhotonicsArtificial InteligenceMicrowave EngineeringWireless Communication
A
Arya Khokhar
Department of Computing and Mathematical Sciences, California Institute of Technology, 1200 E California Blvd, Pasadena, 91125, CA, United States.
Y
Yang Zhang
Andrew and Peggy Cherng Department of Medical Engineering, California Institute of Technology, 1200 E California Blvd, Pasadena, 91125, CA, United States.
C
Chuwei Wang
Department of Computing and Mathematical Sciences, California Institute of Technology, 1200 E California Blvd, Pasadena, 91125, CA, United States.
K
Karteekeya Sastry
Andrew and Peggy Cherng Department of Medical Engineering, California Institute of Technology, 1200 E California Blvd, Pasadena, 91125, CA, United States.; Department of Electrical Engineering, 1200 E California Blvd, Pasadena, 91125, CA, United States.
Julius Berner
Julius Berner
NVIDIA
Deep LearningApplied Mathematics
Yilin Luo
Yilin Luo
California Institute of Technology
Photoacoustic imagingtomography reconstructionbiophotonicsdeep learning
Boris Bonev
Boris Bonev
NVIDIA Research
Scientific ComputingMachine LearningNumerical Linear AlgebraComputational Physics
Zongyi Li
Zongyi Li
MIT
Machine learningScientific computingNeural operator
Kamyar Azizzadenesheli
Kamyar Azizzadenesheli
Nvidia
Machine Learning
Lihong V. Wang
Lihong V. Wang
Andrew and Peggy Cherng Department of Medical Engineering, California Institute of Technology, 1200 E California Blvd, Pasadena, 91125, CA, United States.; Department of Electrical Engineering, 1200 E California Blvd, Pasadena, 91125, CA, United States.
Anima Anandkumar
Anima Anandkumar
California Institute of Technology and NVIDIA
Machine Learning and Artificial Intelligence