Automatic Field-of-View Adjustment for a View-Expansive Microscope via LSTM-Based Gaze and Pipette Motion Interpretation

📅 2026-08-10
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the inefficiency and workflow disruption in intracytoplasmic sperm injection (ICSI) caused by frequent manual adjustments of the microscope’s field of view (FOV). The authors propose an adaptive FOV control method that integrates multi-view imaging, high-speed vision, and a galvanometer-based scanning system. For the first time, the approach combines the operator’s eye-gaze fixation points with real-time pipette position and velocity data, employing a long short-term memory (LSTM) model to predict and automatically adjust the optimal FOV without requiring objective lens changes. Experimental results demonstrate a significant improvement in procedural efficiency: novice operators reduced their average task completion time from 60.5 seconds to 48.0 seconds (p < 0.001), achieving performance comparable to that of experts.
📝 Abstract
Intracytoplasmic sperm injection (ICSI) operators frequently adjust the field-of-view (FOV) during procedures, which interrupts workflow and increases procedure time. Conventional microscopes require manual objective lens switching and illumination adjustments to achieve different FOV sizes. We propose an AI-based automatic FOV adjustment method integrated with a view-expansive microscope. This microscope enables the simultaneous acquisition of a large FOV and high-resolution images using a single objective lens through multiview imaging with galvanometer mirrors and high-speed vision, thereby eliminating the need for physical lens exchanges. Our method utilizes a long short-term memory (LSTM) model to predict the appropriate FOV size based on real-time analysis of the pipette's position and velocity, combined with the operator's gaze position. The AI model is trained using ICSI procedure data from an expert with over five years of micromanipulation experience. Experimental evaluation with novice operators reveals that the proposed automatic FOV adjustment system significantly improves the ICSI procedure speed, reducing the average task completion time from 60.5 to 48.0 s (p < 0.001). The experiments also demonstrate that this improvement enables novice operators to achieve ICSI working speeds equivalent to those of expert operators.
Problem

Research questions and friction points this paper is trying to address.

field-of-view adjustment
intracytoplasmic sperm injection
microscope automation
workflow interruption
procedure time
Innovation

Methods, ideas, or system contributions that make the work stand out.

automatic FOV adjustment
LSTM-based gaze tracking
view-expansive microscope
micromanipulation assistance
real-time motion interpretation
💼 Related Jobs
No related jobs found.
K
Kenta Yokoe
Department of Mechanical Systems Engineering, Nagoya University, Nagoya, Aichi, 464-8603, Japan
T
Takuya Hara
Department of Micro-Nano Mechanical Science and Engineering, Nagoya University, Nagoya, Aichi, 464-8603, Japan
T
Tadayoshi Aoyama
Department of Mechanical Systems Engineering, Nagoya University, Nagoya, Aichi, 464-8603, Japan; Center for One Medicine Innovative Translational Research, Gifu University, Yanagido 1-1, Gifu, Gifu 501-1193, Japan