About the job
As a Staff Research Engineer, you will develop, prototype, and deploy techniques that materially improve how fast and efficiently our models run in production.
Responsibilities
- Develop, prototype, and deploy techniques to improve model efficiency
- Explore and ship breakthroughs across the model execution stack, including model architecture and MoE routing optimization, decoding and inference-time algorithm improvements, software/hardware co-design for GPU acceleration, and performance optimization without compromising model quality
- Mentor others
Qualifications
Minimum
- PhD in Machine Learning or a related field
- Understand LLM architecture and how to optimize LLM inference given resource constraints
- Significant experience with one or more techniques that enhance model efficiency
- Strong software engineering skills
- Publications at top-tier conferences and venues (ICLR, ACL, NeurIPS)
Preferred
No preferred qualifications listed.