Major developer of the 1st version of ManiSkill benchmark, lead organizer of the ManiSkill Challenge 2021 and the Generalizable Policy Learning in the Physical World Workshop. Actively contributed to the development of subsequent generations of ManiSkill, such as ManiSkill 2 and ManiSkill 3. Published multiple papers in top international conferences and journals like CoRL, ICML, TMLR, RSS, and ICLR.
Research Experience
Interned at 1X Technologies, NVIDIA Robotics Lab, Amazon Alexa AI, Wormpex AI, Intel AI, and Microsoft Research Asia. Studied embodied AI from a data-centric perspective, particularly interested in building robot foundation models using non-robot data. Previous research can be summarized as “modeling the world for embodied agents”, including developing robot simulation environments, autonomous robot data collection, reinforcement learning, and imitation learning.
Education
Ph.D. in Computer Science, University of California San Diego, advised by Prof. Hao Su; B.Eng. and M.Sc. in Computer Science from Zhejiang University and UC San Diego, respectively.
Background
Research interests include: Scaling Up Robotic Data Collection, Interfacing Human Operators and Robots using Foundation Models, Creating Tasks, Assets, and Demonstrations in Simulation, Foundation Model for Robotics, Action Generation with Video Foundation Models, Task Planning with Multimodal LLMs, Reinforcement Learning / Imitation Learning, Learning from Demonstrations (Offline and Online), Motion Synthesis with Generative Models (especially Diffusion Models).