MIMIC-MJX: Neuromechanical Emulation of Animal Behavior

📅 2025-11-25
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study aims to infer biologically plausible neural control strategies from animal kinematic trajectories, enabling interpretable modeling of how nervous systems generate natural behaviors. Method: We propose an end-to-end differentiable neural control learning framework that integrates deep reinforcement learning, differentiable physics simulation, and a custom-designed neural controller—optimized solely from raw kinematic data to drive high-fidelity biomechanical models. Contribution/Results: The method achieves cross-species generalizability, high data efficiency, and computational speed. It successfully reconstructs neurobiologically constrained control policies for diverse locomotor behaviors (e.g., walking, jumping), outperforming existing approaches in accuracy, interpretability, and potential for experimental validation. By bridging kinematics, neural dynamics, and biomechanics, our framework establishes a novel paradigm for dissecting motor neural mechanisms and enabling closed-loop behavioral simulation.

Technology Category

Application Category

📝 Abstract
The primary output of the nervous system is movement and behavior. While recent advances have democratized pose tracking during complex behavior, kinematic trajectories alone provide only indirect access to the underlying control processes. Here we present MIMIC-MJX, a framework for learning biologically-plausible neural control policies from kinematics. MIMIC-MJX models the generative process of motor control by training neural controllers that learn to actuate biomechanically-realistic body models in physics simulation to reproduce real kinematic trajectories. We demonstrate that our implementation is accurate, fast, data-efficient, and generalizable to diverse animal body models. Policies trained with MIMIC-MJX can be utilized to both analyze neural control strategies and simulate behavioral experiments, illustrating its potential as an integrative modeling framework for neuroscience.
Problem

Research questions and friction points this paper is trying to address.

Learning neural control policies from kinematic data
Modeling motor control processes in biomechanical simulations
Analyzing neural strategies and simulating behavioral experiments
Innovation

Methods, ideas, or system contributions that make the work stand out.

Learning neural control policies from kinematic data
Training neural controllers to actuate biomechanical models
Reproducing real kinematic trajectories in physics simulation
C
Charles Y. Zhang
Department of Organismic and Evolutionary Biology, Harvard University, Cambridge, MA, USA.
Y
Yuanjia Yang
Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
A
Aidan Sirbu
Mila, Montréal, QC, Canada.
E
Elliott T.T. Abe
Biology Department, University of Washington, Seattle, WA, USA.
E
Emil Wärnberg
Department of Organismic and Evolutionary Biology, Harvard University, Cambridge, MA, USA.
E
Eric J. Leonardis
Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
D
Diego E. Aldarondo
Department of Organismic and Evolutionary Biology, Harvard University, Cambridge, MA, USA.
Adam Lee
Adam Lee
UC Berkeley
Visual Language ModelsPEFTVideo Generation3D
A
Aaditya Prasad
Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
J
Jason Foat
Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
K
Kaiwen Bian
Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
J
Joshua Park
Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
R
Rusham Bhatt
Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
H
Hutton Saunders
Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
A
Akira Nagamori
Molecular Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
A
Ayesha R. Thanawalla
Molecular Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
K
Kee Wui Huang
Molecular Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
F
Fabian Plum
Department of Bioengineering, Imperial College London, London, United Kingdom.
H
Hendrik K. Beck
Department of Bioengineering, Imperial College London, London, United Kingdom.
S
Steven W. Flavell
Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
D
David Labonte
Department of Bioengineering, Imperial College London, London, United Kingdom.
B
Blake A. Richards
Mila, Montréal, QC, Canada.
Bingni W. Brunton
Bingni W. Brunton
Professor, Richard and Joan Komen University Chair, University of Washington, Seattle
Computational neuroscienceNeuromechanicsMachine LearningDynamical Systems
E
Eiman Azim
Molecular Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
B
Bence P. Ölveczky
Department of Organismic and Evolutionary Biology, Harvard University, Cambridge, MA, USA.
T
Talmo D. Pereira
Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.