GOLF: Global Observation with Local Focus for Calibration-Aware Stereo Interaction Field Estimation

📅 2026-09-08
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出GOLF方法,通过结合全局上下文和局部特征,利用改进的DINOv3 ViT-H+/16模型预测手部关节与操作物体间的3D向量,解决立体交互场估计问题。
📝 Abstract
We present GOLF, the first-place solution to the SHOW3D Interaction Field Estimation Challenge at HANDS@ECCV 2026. Given synchronized egocentric stereo views, the task is to predict a 3D vector from each of 21 hand joints to the closest point on the manipulated object. GOLF combines dense global context, locally sampled hand/object evidence, and common-frame Pl\"ucker-ray geometry. We adapt DINOv3 ViT-H+/16 with LoRA and trainable LayerNorm parameters, then jointly decode both interaction fields. Our primary model achieves an official score of 27.61 and a mean ADE of 27.96 mm on the hidden test set. An equal-weight ensemble with a complementary directly fine-tuned variant improves these results to an official score of 27.47 and a mean ADE of 27.82 mm, securing first place.
Problem

Research questions and friction points this paper is trying to address.

stereo views
hand joints
interaction field estimation
3D vector
Innovation

Methods, ideas, or system contributions that make the work stand out.

Global and Local Context
Plücker-ray Geometry
DINOv3 ViT-H+/16 with LoRA
Interaction Field Estimation
🔎 Similar Papers
No similar papers found.
M
Minqiang Zou
JIIOV Technology
R
Riqiang Jin
JIIOV Technology
Z
Zhi Lv
JIIOV Technology
D
Dong Luo
JIIOV Technology
L
Lianghai Tian
JIIOV Technology
Z
Zhenyu Zhao
JIIOV Technology
Q
Qi Xu
JIIOV Technology
T
Tong Wu
JIIOV Technology
M
Mochen Yu
JIIOV Technology
Y
Yao Tang
JIIOV Technology