Flexible Motion Generation from Language and Style References

2026-09-07

AI Summary

为解决文本描述难以捕捉精细动作风格的问题，提出FlexMoGen框架，结合文本和风格示例生成高质量、符合意图且具目标风格的人体动作。

Abstract

We introduce FlexMoGen, a novel framework for flexible human motion synthesis conditioned on both natural language descriptions and motion style references. Text prompts are effective at defining semantic content, but they are often limited in capturing fine-grained style details such as timing, limb articulation, and expressive dynamics. A style example clip supplements the text by conveying these nuanced motion characteristics directly, enabling the model to preserve high-level intent while reproducing the desired stylistic traits. Given a text prompt and a style example clip, FlexMoGen generates high-quality motions that preserve semantic content while faithfully reflecting the target style, offering users greater control over the animation generation process. Unlike prior methods that rely on discrete style labels and do not generalize to long or multi-style generation, FlexMoGen learns a variational style encoder without style supervision and supports long, time-varying, multi-style synthesis. Our framework jointly pre-trains the style encoder and a text-to-motion latent diffusion model within a unified architecture, modulating motion style through a lightweight adaptation module. It integrates an efficient relative positional encoding scheme and is trained on both stylized and non-stylized datasets, enabling strong generalization to unseen text-style combinations. Experiments show that FlexMoGen achieves the best balance between content fidelity and style reflection.

Problem

• Natural Language Descriptions
• Motion Style References
• Human Motion Synthesis
• Content Fidelity
• Style Reflection

Innovation

• variational style encoder
• text-to-motion latent diffusion model
• multi-style synthesis