Received National Scholarship on December 15, 2024; paper 'SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online Parallelization' accepted to USENIX ATC’23.
Research Experience
Was a member of the Tsinghua Student Cluster Competition team.
Education
Received BSc in Computer Science and Technology from Tsinghua University in 2022; currently a third-year Ph.D. student at the PACMAN Lab, Department of Computer Science and Technology, Tsinghua University, advised by Prof. Jidong Zhai.
Background
Research interests include machine learning systems, graph mining systems, and high performance computing. Currently focused on Mixture-of-Expert model optimization.