DOBI: Dynamic Opportunistic Body Input via Spare Joint Recruitment for Hands-Free XR

2026-08-31

AI Summary

为了解决XR系统在用户手忙时的交互问题，研究提出了DOBI方法，通过利用身体其他自由部位进行控制，实现了高效准确的无手操作。

Abstract

Extended Reality (XR) systems are often most useful when users are engaged in ongoing physical tasks, yet current interaction techniques still largely assume the hands are available. We present opportunistic body input, an interaction paradigm that redirects continuous XR control to whichever available body region remains free in the moment. To investigate how users naturally coordinate these spare-body movements, we conducted an elicitation study across six hand-busy scenarios. We found that while users' preferred spare body regions shift dynamically based on physical constraints, the resulting spontaneous movements share a consistent, low-dimensional kinematic structure organized around a dominant principal axis. Building on these findings, we present DOBI (Dynamic Opportunistic Body Input), a real-time XR technique that uses gaze to target a UI element, a brief trigger gesture to identify the recruited spare body region, and the region's subsequent motion to drive continuous 1D control. A 1D Fitts' law study establishes the baseline motor performance of this paradigm across four distinct body regions, achieving throughputs up to 2.62 bits/s with an overall 5.0% error rate, and a dual-task usability study shows that DOBI supports reliable, low-effort control (SUS = 84.2) while users remain engaged in realistic hand-busy activities.

Problem

• Extended Reality
• Hands-Free Interaction
• Spare Body Input

Innovation

• Dynamic Opportunistic Body Input
• spare joint recruitment
• continuous 1D control
• Fitts' law