Jeffrey Willette
Scholar

Jeffrey Willette

Google Scholar ID: G0cJZmAAAAAJ
KAIST, PhD Candidate
Large Language ModelsEfficient AttentionDeep LearningSelf-Supervised Learning
Citations & Impact
All-time
Citations
482
 
H-index
5
 
i10-index
2
 
Publications
11
 
Co-authors
11
list available
Resume (English only)
Academic Achievements
  • Published multiple papers at top-tier conferences including ICLR, ICML, NeurIPS, and CVPR
  • Notable works: 'Training-Free Exponential Extension of Sliding Window Context with Cascading KV Cache' (ICLR 2025)
  • 'SEA: Sparse Linear Attention with Estimated Attention Mask' (ICLR 2024, equal contribution)
  • 'Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation' (ICML 2023, equal contribution)
  • 'Exploring the Role of Mean Teachers in Self-Supervised Masked Auto-Encoders' (ICLR 2023, equal contribution)
  • 'MPViT: Multi-Path Vision Transformer for Dense Prediction' (CVPR 2022)
  • 'Meta Learning Low Rank Covariance Factors for Energy-Based Deterministic Uncertainty' (ICLR 2022)
  • 'MiniBatch Consistent Slot Set Encoder for Scalable Set Encoding' (NeurIPS 2021)
  • Preprint: 'Prior Augmented Data: Targeted Entropy Regularization for Improved Calibration'