Scholar
Anshumali Shrivastava
Google Scholar ID: SGT23RAAAAAJ
Rice University, ThirdAI Corp.
Machine Learning
Large Scale Deep Learning
Information Retrieval
Follow
Homepage
↗
Google Scholar
↗
Citations & Impact
All-time
Citations
3,882
H-index
34
i10-index
73
Publications
20
Co-authors
0
Contact
CV
Open ↗
Twitter
Open ↗
GitHub
Open ↗
Publications
9 items
Scout Before You Attend: Sketch-and-Walk Sparse Attention for Efficient LLM Inference
2026
Cited
0
SOCKET: SOft Collison Kernel EsTimator for Sparse Attention
2026
Cited
0
Replacing Softmax Similarity with a Sharpened Angular Similarity: Theory and Practice of Scaling To Billion-Context Attention
2025
Cited
0
To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration
2025
Cited
0
REFRAG: Rethinking RAG based Decoding
2025
Cited
0
CoVE: Compressed Vocabulary Expansion Makes Better LLM-based Recommender Systems
2025
Cited
0
70% Size, 100% Accuracy: Lossless LLM Compression for Efficient GPU Inference via Dynamic-Length Float
2025
Cited
0
I3S: Importance Sampling Subspace Selection for Low-Rank Optimization in LLM Pretraining
2025
Cited
0
Load more
Resume (English only)
Academic Achievements
Selected Preprints:
- Replacing Softmax Similarity with a Sharpened Angular Similarity: Theory and Practice of Scaling To Billion-Context Attention
- To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration
- REFRAG: Rethinking RAG based Decoding
Commercial Deployments:
- Amazon Product Search: Deployment of our hashing algorithm based on FLASH Engine (SIGMOD 2018) in the Amazon Search Engine
- BOLT Engine: At ThirdAI Corp., developing sparsity and hash tables to democratize AI on CPUs
Awards/Honors:
- Charles W. Duncan Jr. Achievement Award for Outstanding Faculty 2023
- IIT Kharagpur, Young Alumni Achiever Award (YAAA), 2023
- Outstanding Paper Award, MLSys 2022
- Awarded Tenure at Rice (Early)
- George R. Brown School of Engineering, Rice University, 2021 Young Faculty Research Award
- Adobe Data Science Research Awards 2021
- National Academy of Engineers (NAE) 2019 US Frontiers of Engineering Alum
- ACM SIGMOD 2018 Most Reproducible Paper Award
- Science News 10 Scientist to Watch, 2018
- Best Student Paper Competition Award at IISA, 2018
- Amazon Research Awards, 2017
- AFOSR Young Investigator Award (YIP), 2017
- NSF CAREER AWARD, 2017
- NIPS Best Paper, 2014
- IEEE/ACM ASONAM Best Paper, 2014
- Institute Silver Medal, IIT Kharagpur, 2008
Research Experience
Previously held positions at Amazon, AWS, Blackstone, and FICO
Founder of ThirdAI Corp. (Acquired in August 2025) and xmad.ai (Sept 2024) --> Workato (July 2025)
Education
Information not provided
Background
Currently at Meta Superintelligence Labs (on Leave from Rice)
Professor, Computer Science and Ken Kennedy Institute, Rice University
Research Interests: Large Scale Machine Learning, Scalable and Sustainable Deep Learning, Randomized Algorithms for AI/LLMs, Information Retrieval
Miscellany
Personal Interests: Writing about AI, Businesses, LLMs
Blogging Platforms: Medium
Co-authors
0 total
Co-authors: 0 (list not available)
×
Welcome back
Sign in to Agora
Welcome back! Please sign in to continue.
Email address
Password
Forgot password?
Continue
Do not have an account?
Sign up