About the job
As a Senior Research Engineer at Microsoft, you will advance Microsoft’s mission to empower every person and every organization to achieve more. You will help build and integrate cutting-edge AI into Microsoft products and services within the Business & Industry Copilot (BIC) group, ensuring solutions are inclusive, ethical, and impactful. This role blends applied research, machine learning engineering, and product innovation. You will lead efforts to ship reliable, production-grade AI systems across the stack, from model development and fine-tuning to performance optimization and deployment.
Responsibilities
Design and implement AI systems using foundation models, prompt engineering, retrieval-augmented generation, multi-agent architectures, and classic ML.
Fine-tune large language models on domain-specific data and evaluate via offline and online methods such as A/B testing, telemetry, and shadow deployments.
Build and harden prototypes into production-ready services using robust software engineering and MLOps practices.
Drive original research and thought leadership (whitepapers, internal notes, patents); convert insights into shipped capabilities.
Research Translation: Continuously review emerging work; identify high-potential methods and adapt them to Microsoft problem spaces.
ML Design & Architecture: Own end-to-end pipeline from data prep, training, evaluation, deployment, and feedback loops.
Identify and resolve model quality gaps, latency issues, and scale bottlenecks using PyTorch, or TensorFlow.
Operate CI/CD and MLOps workflows including model versioning, retraining, evaluation, and monitoring.
Integrate AI components into Microsoft products in close partnership with
Qualifications
Minimum
Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Proficiency in Python and at least one deep learning framework such as PyTorch, JAX, or TensorFlow.
Experience deploying Fine Tuned LLMs or multimodal models in live production environments.
Experience shipping and maintaining production AI systems.
Preferred
Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, Physics, or a related field and 1 or more years in applied ML or AI research and product engineering, OR 1 or more years experiece with generative AI, LLMs, or related ML algorithms.
Experience with Microsoft’s LLMOps stack: Azure AI Foundry, Azure Machine Learning, Semantic Kernel, Azure OpenAI Service, and Azure AI Search for vector/RAG.
Familiarity with responsible AI evaluation frameworks and bias mitigation methods.
Experience across the product lifecycle from ideation to shipping.