About the job
We are looking for a Principal Software Engineer to help build the future of AI infrastructure at Microsoft. This is an opportunity to work on cutting-edge AI technologies at a scale and impact that is difficult to find anywhere else. You will partner with teams across CAP and Microsoft to build the AI inferencing platform that enables engineers and applied scientists to rapidly develop AI-powered innovations using the latest models and technologies in a compliant, reliable, and cost-efficient manner.
Responsibilities
Lead the design, implementation, and delivery of LLM API management service for millions of customers
Maniacally manage cost and availability – set the benchmark for the industry
Coach your team for building and running large scale platforms and experiences that get used by hundreds of millions of users every day
Work independently and collaboratively with other product teams across Power Platform, BizApps, and Microsoft
Qualifications
Minimum
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Solid coding skills in Python and/or C#, .Net.
Solid technical expertise, met by proficiency in implementing 2 or more of the following or equivalent areas: 4+ years building and running high scale services.
Experience with LLMs, orchestrators, embedding models, and vector databases.
Implementation of Distributed Systems.
Implementation of Message based architecture.
High scale OLTP or OLAP storage implementations.
Experience leading and delivering projects that span multiple engineering organizations.