Scholar
Liliang Ren
Google Scholar ID: 9MBMglQAAAAJ
Microsoft GenAI
Neural Networks
Long Sequence Modeling
Large Language Models
Follow
Homepage
↗
Google Scholar
↗
Citations & Impact
All-time
Citations
2,862
H-index
9
i10-index
9
Publications
20
Co-authors
8
list available
Contact
Email
liliang3@illinois.edu
CV
Open ↗
Twitter
Open ↗
GitHub
Open ↗
LinkedIn
Open ↗
Publications
13 items
Rethinking Language Model Scaling under Transferable Hypersphere Optimization
2026
Cited
0
GeoNorm: Unify Pre-Norm and Post-Norm with Geodesic Optimization
2026
Cited
0
ThetaEvolve: Test-time Learning on Open Problems
2025
Cited
0
Understanding the Mixture-of-Experts with Nadaraya-Watson Kernel
2025
Cited
0
SAS: Simulated Attention Score
2025
Cited
0
Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
2025
Cited
0
Routing Mamba: Scaling State Space Models with Mixture-of-Experts Projection
2025
Cited
0
PaTH Attention: Position Encoding via Accumulating Householder Transformations
2025
Cited
0
Load more
Resume (English only)
Academic Achievements
5 papers accepted at NeurIPS 2025: SambaY, Routing Mamba, PaTH Attention, 1-shot RLVR, and SAS
July 2025: Released Phi-4-mini-flash-reasoning with paper and training codebase based on μP++ and SambaY architecture
June 2024: Announced Samba-3.8B paper, outperforming Phi-3-mini on major benchmarks with infinite context length and linear complexity
One paper on Efficient Sequence Modeling accepted at NeurIPS 2023
May 2023: Paper on Dialogue Evaluation accepted for oral presentation at ACL 2023 DialDoc workshop
October 2022: Paper on Language Model Pre-training accepted as Oral at EMNLP 2022
Published multiple works on efficient sequence modeling, sparse modular activation, and Samba architecture
Co-authors
8 total
Yelong Shen
Microsoft
Weizhu Chen
Microsoft, Technical Fellow
Kai Yu(俞凯)
Shanghai Jiao Tong University
ChengXiang Zhai
University of Illinois at Urbana-Champaign
Heng Ji
Professor of Computer Science, AICE Director, ASKS Director, UIUC, Amazon Scholar
Julian McAuley
Professor, UC San Diego
Julia Hockenmaier
Professor, University of Illinois at Urbana-Champaign (UIUC)
Co-author 8
×
Welcome back
Sign in to Agora
Welcome back! Please sign in to continue.
Email address
Password
Forgot password?
Continue
Do not have an account?
Sign up