Scholar
Jeffrey Willette
Google Scholar ID: G0cJZmAAAAAJ
KAIST, PhD Candidate
Large Language Models
Efficient Attention
Deep Learning
Self-Supervised Learning
Follow
Homepage
↗
Google Scholar
↗
Citations & Impact
All-time
Citations
482
H-index
5
i10-index
2
Publications
11
Co-authors
11
list available
Contact
GitHub
Open ↗
Publications
3 items
Robust Molecular Property Prediction via Densifying Scarce Labeled Data
2025
Cited
0
Delta Attention: Fast and Accurate Sparse Attention Inference by Delta Correction
2025
Cited
0
Training-Free Exponential Context Extension via Cascading KV Cache
2024
Cited
0
Resume (English only)
Academic Achievements
Published multiple papers at top-tier conferences including ICLR, ICML, NeurIPS, and CVPR
Notable works: 'Training-Free Exponential Extension of Sliding Window Context with Cascading KV Cache' (ICLR 2025)
'SEA: Sparse Linear Attention with Estimated Attention Mask' (ICLR 2024, equal contribution)
'Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation' (ICML 2023, equal contribution)
'Exploring the Role of Mean Teachers in Self-Supervised Masked Auto-Encoders' (ICLR 2023, equal contribution)
'MPViT: Multi-Path Vision Transformer for Dense Prediction' (CVPR 2022)
'Meta Learning Low Rank Covariance Factors for Energy-Based Deterministic Uncertainty' (ICLR 2022)
'MiniBatch Consistent Slot Set Encoder for Scalable Set Encoding' (NeurIPS 2021)
Preprint: 'Prior Augmented Data: Targeted Entropy Regularization for Improved Calibration'
Co-authors
11 total
Sung Ju Hwang
KAIST, DeepAuto
Youngwan Lee
Electronics and Telecommunications Research Institute; KAIST
Jonghee Kim
Electronics and Telecommunications Research Institute
Juho Lee
Associate professor, KAIST
Bruno Andreis
KAIST
Heejun Lee
Korea Advanced Institute of Science and Technology
Jina Kim
Undergrad at KAIST, School of Computing
Co-author 8
×
Welcome back
Sign in to Agora
Welcome back! Please sign in to continue.
Email address
Password
Forgot password?
Continue
Do not have an account?
Sign up