🤖 AI Summary
This work addresses the longstanding “last mile” problem in video-based motion capture, where reconstructed motions often exhibit physical implausibility and artifacts that necessitate extensive manual correction for industrial applications such as film and gaming. The authors propose a production-oriented physics-aware motion refinement framework that enhances both single- and multi-person motion sequences through physics-based optimization while seamlessly integrating keyframe editing to allow animators to inject stylistic adjustments. Developed in close collaboration with professional animators, the method balances automation efficiency with artist control, significantly improving the physical plausibility and visual quality of motion data. This approach markedly reduces post-processing effort and is designed to fit directly into real-world animation pipelines.
📝 Abstract
High-quality motion data underpins games, film, XR, and robotics. Vision-based motion capture tools have made significant progress, offering accessible and visually convincing results, yet often fall short in the final stretch—the last mile—when it comes to physical realism and production readiness, due to various artifacts introduced during capture. In this paper, we summarize key issues through case studies and feedback from professional animators to set a stepping stone for future research in motion cleanup. We then present a physics-based motion refinement framework to bridge the gap, with the goal of reducing labor-intensive manual clean-up and enhancing visual quality and physical realism. Our framework supports both single- and multi-character sequences and can be integrated into animator workflows for further refinement, such as stylizing motions via keyframe editing.