Published some research works such as LoRA, DeBERTa, Phi, Rho-1 (Rho-1 won the best paper runner-up award at Neurips-2024). For more recent works, please check Google Scholar.
Research Experience
Leading the modeling team in Microsoft GenAI, responsible for large-scale model training, post-training, pre-training, and data processing.
Background
Currently leading a modeling team in Microsoft GenAI. The team works on large-scale (OpenAI and Microsoft) model training, including post-training, pre-training, and data.