Jan Małaśnicki
Scholar

Jan Małaśnicki

Google Scholar ID: k5GRlOIAAAAJ
Master Student, University of Warsaw
machine learningLarge Language ModelsMixture of Experts
Google Scholar↗
Citations & Impact
All-time
Citations
3
 
H-index
1
 
i10-index
0
 
Publications
4
 
Co-authors
10
list available
Contact
No contact links provided.
Publications
4 items
$μ$-Parametrization for Mixture of Experts
2025
Cited
0
Decoupled Relative Learning Rate Schedules
2025
Cited
0
Projected Compression: Trainable Projection for Efficient Transformer Compression
2025
Cited
0
Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient
2025
Cited
0
Resume (English only)
Co-authors
10 total
Maciej Pióro
Maciej Pióro
PhD Student, Polish Academy of Sciences / IDEAS NCBR
Marek Cygan
Marek Cygan
University of Warsaw
Michał Krutul
Michał Krutul
IDEAS NCBR, University of Warsaw
Kamil Adamczewski
Kamil Adamczewski
Max Planck Institute for Intelligent Systems
Jan Ludziejewski
Jan Ludziejewski
Mistral AI
Jakub Krajewski
Jakub Krajewski
PhD Student, University of Warsaw, IDEAS NCBR
Sebastian Jaszczur
Sebastian Jaszczur
Anthropic (past: IDEAS, University of Warsaw)
Co-author 8
Co-author 8