SurgLAT: Surgical Latent Attention Tracking for Depth-Aware Robotic Laparoscope Control
This work addresses the challenge of autonomous laparoscope control by interpreting surgeons’ implicit and time-varying operational intent in dynamic surgical environments, rather than tracking static targets. To this end, the authors propose SurgLAT, a novel framework that models implicit surgical attention as a causally evolving latent state. SurgLAT integrates memory-guided spatial priors with a dynamic retrieval mechanism to robustly track regions of interest. The method employs a frozen DINOv2 encoder, a state-conditioned spatial token mixer, a selective causal latent memory module, and a probabilistic attention heatmap decoder, combined with redundancy-aware null-space control respecting remote center of motion (RCM) constraints to ensure smooth and stable endoscope motion. Experiments demonstrate that the system exhibits strong robustness to occlusions, rapid movements, and target switches on both real surgical videos and robotic platforms.