Principal Software Engineer, CoreAI

Microsoft
San Francisco Bay area / New York City metropolitan area2026-03-13onsite

About the job

Joining the CoreAI organization at Microsoft means becoming part of the team that builds the end-to-end AI stack powering Azure’s innovation. As a member of the FIT training team within CoreAI, you will help develop the AI infrastructure that accelerates the creation of agentic AI systems across Microsoft. This role is dedicated to advancing scientific methods and scalable infrastructure for training agentic models to achieve frontier-level performance. You will contribute to LLMs, SLMs, and agentic models using both proprietary and open-source frameworks, all aimed at delivering reliable, enterprise-grade agentic workflows.

Responsibilities

Collaboration with engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models. Design, build and improve services with high scalability and reliability. Design and implement the services to serve the prod traffic and fulfill the security and privacy requirements. Participate in efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments. Contribute to the deployment and monitoring of services in production environments.

Qualifications

Minimum

Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python, or equivalent experience. Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years

Preferred

Experience working with engineering teams to deliver large-scale software systems, preferably in AI, machine learning, graphics or related fields. Thrive in a fast-paced, collaborative environment and are comfortable making progress in ambiguity. Enjoy working closely with cross-functional partners and teammates in an inclusive, curious culture. Have strong opinions about best investments to make in establishing the most delightful and performant AI companion engineering system.