Matus Telgarsky
Scholar

Matus Telgarsky

Google Scholar ID: Fc-5yRIAAAAJ
Courant Institute of Mathematical Sciences, New York University
deep learning theorymachine learning theory
Citations & Impact
All-time
Citations
5,597
 
H-index
23
 
i10-index
33
 
Publications
20
 
Co-authors
25
list available
Resume (English only)
Academic Achievements
  • 2013: Showed coordinate descent (and steepest descent) converges to maximum margin solutions
  • 2016: Constructed deep networks inapproximable by shallow ones unless exponentially wide
  • 2018: Extended classical margin-based generalization theory to deep networks
  • 2019: Large-margin analysis of gradient descent for non-separable data, with a succinct SGD proof (1/t rate)
  • 2020: Proved directional convergence of gradient descent for shallow and deep ReLU networks near initialization
  • 2024: Interpreted (decoder-)Transformer layers as parallel computation rounds; showed logistic regression is insensitive to step size