Scholar
Tatsuya Aoyama
Google Scholar ID: AvhNwScAAAAJ
Research Scientist, Meta
language modeling
pretraining dynamics
interpretability
cognitive science
Follow
Homepage
↗
Google Scholar
↗
Citations & Impact
All-time
Citations
151
H-index
6
i10-index
4
Publications
17
Co-authors
9
list available
Contact
Twitter
Open ↗
GitHub
Open ↗
LinkedIn
Open ↗
Publications
6 items
Predicting the Formation of Induction Heads
2025
Cited
0
Unpacking Let Alone: Human-Scale Models Generalize to a Rare Construction in Form but not Meaning
2025
Cited
0
Language Models Grow Less Humanlike beyond Phase Transition
2025
Cited
0
Anything Goes? A Crosslinguistic Study of (Im)possible Language Learning in LMs
2025
Cited
0
Generalized Kernel Inducing Points by Duality Gap for Dataset Distillation
2025
Cited
0
Distributionally Robust Coreset Selection under Covariate Shift
2025
Cited
0
Resume (English only)
Academic Achievements
Published 'Language Models Grow Less Humanlike beyond Phase Transition' at ACL 2025 (with Ethan Wilcox)
Published 'Anything Goes? A Crosslinguistic Study of (Im)possible Language Learning in LMs' at ACL 2025 (with Xiulin Yang, Yuekun Yao, Ethan Wilcox)
Published 'Modeling Nonnative Sentence Processing with L2 Language Models' at EMNLP 2024 (with Nathan Schneider)
Published 'Probe-Less Probing of BERT’s Layer-Wise Linguistic Knowledge with Masked Word Prediction' at NAACL-SRW 2022 (with Nathan Schneider)
Co-authored 'Predicting the Formation of Induction Heads' at CogInterp @ NeurIPS 2025 (with Ethan Wilcox and Nathan Schneider)
Co-authored 'Unpacking Let Alone: Human-Scale Models Generalize to a Rare Construction in Form but not Meaning' at EMNLP 2025
Co-authored 'GDTB: Genre Diverse Data for English Shallow Discourse Parsing across Modalities, Text Types, and Domains' at EMNLP 2024
Contributed to 'Global PIQA: Evaluating Physical Commonsense Reasoning Across 100+ Languages and Cultures' on arXiv 2025
Co-authors
9 total
YANG JANET LIU
Assistant Professor of Computational Linguistics, University of Pittsburgh
Amir Zeldes
Associate Professor of Computational Linguistics, Georgetown University
Nathan Schneider
Associate Professor, Linguistics and Computer Science • Georgetown University
Siyao (Logan) Peng
Postdoc, MaiNLP lab @ LMU Munich
Co-author 5
Co-author 6
Co-author 7
Yilun Zhu
Postdoctoral Scientist, Amazon
×
Welcome back
Sign in to Agora
Welcome back! Please sign in to continue.
Email address
Password
Forgot password?
Continue
Do not have an account?
Sign up