Shida Wang
Scholar

Shida Wang

Google Scholar ID: vA2YMfgAAAAJ
National University of Singapore
Sequence ModellingLarge Language Model
Citations & Impact
All-time
Citations
109
 
H-index
6
 
i10-index
5
 
Publications
12
 
Co-authors
11
list available
Resume (English only)
Academic Achievements
  • - Publications:
  • 1. Inverse Approximation Theory for Nonlinear Recurrent Neural Networks (ICLR 2024, spotlight)
  • 2. StableSSM: Alleviating the Curse of Memory in State-space Models through Stable Reparameterization (ICML 2024)
  • 3. State-space models with layer-wise nonlinearity are universal approximators with exponential decaying memory (NeurIPS 2023)
  • 4. Efficient Hyperdimensional Computing (ECML 2023)
  • 5. A Brief Survey on the Approximation Theory for Sequence Modelling (JML 2023)
  • 6. Integrating Deep Learning and Synthetic Biology: A Co-Design Approach for Enhancing Gene Expression via N-terminal Coding Sequences (ACS Synthetic Biology)
  • - Manuscripts:
  • 1. LongSSM: On the Length Extension of State-space Models in Language Modelling (ICML 2024 NGSM workshop)
  • 2. Improve Long-term Memory Learning Through Rescaling the Error Temporally
  • 3. HyperSNN: A new efficient and robust deep learning model for resource constrained control applications
  • 4. Learning Relational Tabular Data without Shared Features
Research Experience
  • - 2025.01-Present: XTY AI residency (New York)
  • - 2024.04-2024.08: 01.AI Multi-modal Intern
  • - 2023.04-2023.12: Sea AI Lab Intern
  • - 2021.08-2021.10: Advance.AI R&D Intern
  • - 2019.07-2020.01: Megvii Intern
  • - 2019.01-2019.02: Goku-data Intern
Education
  • - Ph.D. in Mathematics, National University of Singapore, 2020-2024, Advisor: Professor Li Qianxiao
  • - B.S. in Mathematics, Fudan University, 2016-2020
Background
  • - Research Interests: Sequence modeling, language models, and nonlinear systems
  • - Field: Applied Mathematics, Machine Learning
Miscellany
  • - Skills: Python (PyTorch, JAX, TensorFlow), C/C++, Haskell
  • - Languages: Chinese (Mandarin) and English
  • - Travel Experiences:
  • 1. 2023.12.10-2023.12.16: New Orleans, NeurIPS 2023
  • 2. 2024.01.08-2024.01.12: GYSS
  • 3. 2024.05.06-2024.05.10: Vienna, ICLR 2024
  • 4. 2024.07.08-2024.07.12: Symposium on ML and DS
  • 5. 2024.07.15-2024.07.19: SciCADE
  • 6. 2024.07.21-2024.07.27: Vienna, ICML 2024
  • 7. 2024.08.19-2024.08.20: Changsha, Central South University
  • 8. 2024.08.30-2024.09.01: Ningbo, Eastern Institute of Technology
  • 9. 2024.09.04-2024.09.08: Shanghai, Fudan University
  • 10. 2024.11.15: CRUNCH seminar
  • 11. 2024.12.10-2024.12.16: Vancouver, NeurIPS 2024 (Top Reviewers)
  • - Teaching Assistant Positions:
  • 1. DSA5102 (2021.08-11)
  • 2. DSA5101, DSA5102 (2020.08-11)