Selected publications: Preserving Near-Optimal Gradient Sparsification Cost for Scalable Distributed Deep Learning, CCGrid 2024; MiCRO: Near-Zero Cost Gradient Sparsification for Scaling and Accelerating Distributed DNN Training, HiPC 2023; DEFT: Exploiting Gradient Norm Difference between Model Layers for Scalable Gradient Sparsification, ICPP 2023; and other papers.
Research Experience
Software Engineer at SK hynix, Republic of Korea, Oct. 2024 ~ Present (Memory Systems Research); Researcher at Electronics and Telecommunications Research Institute (ETRI), Republic of Korea, Jan. 2024 ~ Oct. 2024 (High Performance Computing System Research Section)
Education
Ph.D. in Department of Artificial Intelligence, Ajou University, Sep. 2018 - Feb. 2024; B.S. in Department of Software, Ajou University, Mar. 2013 - Aug. 2018
Background
Research Interests: GPU architecture, Large language models, Computer architecture, Memory subsystem