Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing

📅 2026-08-16
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the inherent trade-off between semantic responsiveness and structural fidelity in text-driven 3D motion editing by proposing the CIME framework. The method introduces a novel spatiotemporal collaborative decoupling mechanism that disentangles variations and invariances into pose and rhythm dimensions. By integrating fully supervised positive-negative learning with Riemannian Non-uniform Integral Manifold Mapping (RNIMM), CIME achieves a refined balance between semantic alignment and physical rhythmic consistency. Experimental results on benchmarks such as MotionFix demonstrate that CIME attains state-of-the-art performance, significantly enhancing both editing alignment and structural preservation. The source code and pretrained models have been made publicly available to facilitate future research.
📝 Abstract
Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the structural consistency of the original motion. Existing diffusion-based approaches struggle to balance text-responsive "change" and inertial "invariance". They often rely on coarse spatial constraints and rigid uniform time assumptions, leading to spatial motion distortions and the destruction of intrinsic physical rhythms during variable-length editing. To handle these challenges, we propose Change and Invariance Motion Editing (CIME), a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions. For spatial poses, our method integrates an omni-supervised positive-negative learning mechanism comprising hierarchical retrospective feature supervision, subtle motion preservation, and triplet-based semantic alignment. For temporal rhythms, we introduce the Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module, which achieves high-fidelity reproduction of physical beats in the edited text via kinematics-aware non-uniform timestamps. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity, validating the effectiveness of our unified architecture. Our source codes and models have been released at: github.com/ZhenwuShi/CIME.git
Problem

Research questions and friction points this paper is trying to address.

Text-driven 3D Human Motion Editing
Change and Invariance Balance
Spatial Motion Distortion
Physical Rhythm Preservation
Innovation

Methods, ideas, or system contributions that make the work stand out.

Change and Invariance Decoupling
Omni-supervised Positive-Negative Learning
Riemannian Non-uniform Integral Manifold Mapping
Text-driven 3D Human Motion Editing
Kinematics-aware Timestamps
🔎 Similar Papers
No similar papers found.
S
Shaohui Lin
School of Computer Science and Technology, East China Normal University, Shanghai 200062, China
Z
Zhenwu Shi
Shanghai Institute of Artificial Intelligence for Education, East China Normal University, Shanghai 200062, China
Jingyu Gong
Jingyu Gong
Shanghai Jiao Tong University
3D Computer Vision
J
Jiao Xie
School of Statistics, East China Normal University, Shanghai 200062, China
Yu Zhou
Yu Zhou
LMAM, School of Mathematical Sciences, Peking University
Biomedical imaging
Baochang Zhang
Baochang Zhang
Technische Universität München
Computer assisted interventionMedical image analysisDeep learning
L
Lizhuang Ma
School of Computer Science and Technology, East China Normal University, Shanghai 200062, China; School of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
C
Chia-Wen Lin
Department of Electrical Engineering, National Tsing Hua University, Hsinchu 300044, Taiwan