Published papers include but are not limited to: DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers, SeedLoRA: A Fusion Approach to Efficient LLM Fine-Tuning, Concerto: Automatic Communication Optimization and Scheduling for Large-Scale Deep Learning, etc.
Research Experience
No specific work experience or research projects described.
Education
PhD Student, HPC-AI Lab, School of Computing, National University of Singapore, Advisor: Prof. Yang You.
Background
Research Interests: Machine learning systems, especially parallel systems for large models; aims to build high-performance systems for large-scale machine learning. Currently focusing on three topics: automated parallelization and communication optimization, efficient video generation, and high-performance AI systems based on the ARM platform.