About the job
As a Senior Software Engineer - System Optimization, you will drive innovation across the AI software stack with a strong focus on high performance inference systems. You will lead benchmarking and optimization of state-of-the-art LLMs across GPUs and Microsoft’s custom AI hardware, architect improvements to largescale serving pipelines, and diagnose complex performance bottlenecks across distributed systems. You will own critical metrics, design and implement robust optimizations, and partner closely with research, hardware, and production teams to ship cutting edge capabilities into Microsoft’s most heavily used AI workloads—directly influencing Azure’s efficiency and Microsoft’s next generation of AI infrastructure.
Responsibilities
Software development in C++, Python, and other languages for specialized accelerators and host systems
Software design, development and optimization to execute AI workloads at the cloud scale
Co-design with hardware partner teams on HW/SW interfaces
Design and code review of peer work
Qualifications
Minimum
Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience
Preferred
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience. PhD Degree in Computer Science or related technical field AND technical engineering experience with coding in languages including, but not limited to, C, C++, or Python 1+ year of experience with Large Language Models (LLMS) and large scale execution on AI workloads 3+ years of technical design, problem solving, and debugging skills