Beyond Object Selection:Markerless Gaze-based Robot Placement at Arbitrary Position

📅 2026-08-31
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究通过无标记的眼球追踪方法解决机器人在任意位置的放置问题,提出基于图的参考选择和多种任务特定对齐管道,并引入GSIE评估方法。
📝 Abstract
Gaze-based assistive manipulation typically supports object selection, while arbitrary-position placement requires accurate spatial alignment between the headset and robot. However, for gaze-based manipulation, pose accuracy does not necessarily translate into task accuracy: translational and rotational errors jointly affect the transformed gaze ray and may compensate for each other. To study cross-device alignment from this task-oriented perspective, we present a markerless interaction framework and a dedicated cross-device dataset. We propose Graph-based Reference Selection to address sparse robot references. We further develop and benchmark multiple task-specific alignment pipelines under a unified protocol. Specifically, we introduce Gaze--Surface Intersection Error (GSIE), which directly measures the spatial error of the gaze-specified target. Experiments show that alignment methods ranked highly by conventional pose metrics are not always optimal in GSIE, demonstrating the importance of evaluating gaze-based manipulation at the task level.
Innovation

Methods, ideas, or system contributions that make the work stand out.

Markerless Interaction
Graph-based Reference Selection
Gaze-surface Intersection Error
Task-specific Alignment
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
Y
Yuzhi Lai
University of Tuebingen, Geschwister-Scholl-Platz, 72074 Germany
W
William Marx
University of Tuebingen, Geschwister-Scholl-Platz, 72074 Germany
S
Shenghai Yuan
Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798
Peizheng Li
Peizheng Li
Mercedes-Benz AG R&D & University of Tuebingen
Computer VisionMultimodal ModelsAutonomous Driving
Z
Zhuoyu Ran
University of Tuebingen, Geschwister-Scholl-Platz, 72074 Germany
Andreas Zell
Andreas Zell
Professor für Informatik, Universität Tübingen
RobotikBioinformatikMaschinelles LernenKünstliche IntelligenzBildverarbeitung