Published multiple papers such as 'PipeLLM: Fast and Confidential Large Language Model Services with Speculative Pipelined Encryption' (ASPLOS 2025), 'PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU' (SOSP 2024), etc. Served as a program committee member and journal reviewer for several top conferences.
Research Experience
Associate Professor at the School of Software, Shanghai Jiao Tong University. Research areas include LLM systems, operating systems, and system virtualization.
Education
Ph.D. in Computer Science from Shanghai Jiao Tong University, advised by Prof. Haibo Chen and Prof. Binyu Zang; Bachelor's degree in Software Engineering from Nanjing University.
Background
Research interests include LLM systems, operating systems, and system virtualization. Currently developing the next generation of edge-side large language model training, inference, and intelligent agent systems.
Miscellany
Offers internship opportunities to self-motivated students eager to make an impact through these systems.