About the job
The Microsoft Copilot Studio Applied Science and Research organization seeks a seasoned Principal Applied Scientist, a machine learning engineer to contribute to the development and integration of cutting-edge AI technologies into Microsoft Copilot Studio, ensuring they are inclusive, ethical, and impactful. You will collaborate across product, design, research and engineering teams to bring innovative solutions to life, applying your expertise in machine learning, data science, and software engineering to solve complex problems. Your work will directly influence product quality and customer experiences.
Responsibilities
Design, implement and experiment with AI architectures for improving Large Language Models (LLM) inference systems. This includes design patterns pertaining, but not limited to, Retrieval Agumented Generation (RAG), Context Engineering, Multi-Agent architectures, tool design etc.
Develop robust evaluation frameworks to assess model performance, monitor model behavior, conduct systematic benchmarking, and address identified weaknesses while ensuring compliance with customer standards.
Build and maintain internal tools to streamline model fine-tuning and evaluation workflows and automate repetitive tasks within secure development environments.
Prepare and analyze data for machine learning, identifying optimal features and addressing data gaps.
Implement machine learning algorithms, large-scale model fine-tuning, especially with closed and open source LLMs, Small Language Models (SLMs), multimodal or task-specific models to solve real-world customer problems and deliver measurable product and customer impact.
Contribute to or enhance existing innovations by continuously refining well-established models and training techniques through iterative improvements.
Write efficient, high quality production code and debug complex distributed systems.
Provide deep subject matter expertise in AI subfields (e.g., deep learning, Generative AI, Natural Language Processing(NLP), muti-modal models, reinforcement learning) to help translate cutting-edge research into practical, real-world solutions that drive product innovation and business impact.
Demonstrate deep understanding of small and large language models (SLMs and LLMs) architecture and optimization techniques to adapt out-of-the-box solutions to particular business problems.
Qualifications
Minimum
Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics predictive analytics, research)OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research)OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ year(s) related experience (e.g., statistics, predictive analytics, research)OR equivalent experience. Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred
Bachelor’s degree in Computer Science, Statistics, Electrical/Computer Engineering, Physics, Mathematics or related field AND 9+ years of experience in AI/ML, predictive analytics, software engineering or researchOR Master’s degree AND 7+ years of relevant experienceOR PhD AND 5+ year of relevant experienceOR equivalent experienceExperience with MLOps Workflows, including CI/CD, monitoring, and retraining pipelines.Familiarity with modern LLMOps frameworks (e.g., LangChain, PromptFlow).Familiar with AI coding assistant, AI IDE, Agentic coding assistant such as GitHub Copilot, and Cursor.3+ years of experience conducting applied AI or NLP research in academic or industry settings.3+ year of experience developing and deploying live production systems or AI services.2+ years of experience working with Generative AI or large-scale deep learning models and ML stacks.