Scholar
Druv Pai
Google Scholar ID: GdOmgYwAAAAJ
PhD Student, UC Berkeley
Citations & Impact
Citations
319
H-index
10
i10-index
10
Publications
17
Co-authors
10
list available
Publications
Resume (English only)
Academic Achievements
- Learning Deep Representations of Data Distributions – Open-source textbook.
- Token Statistics Transformer: Linear-Time Attention via Variational Rate Reduction – ICLR 2025 (Spotlight).
- On the Edge of Memorization in Diffusion Models.
- White-Box Transformers via Sparse Rate Reduction: Compression is all There Is? – JMLR 2024 (parts presented at NeurIPS 2023, ICLR 2024, CPAL 2024).
- Simplifying DINO via Coding Rate Regularization – ICML 2025.
- Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs.
