About the job
Microsoft’s Enterprise customers need tools to build agentic experiences over public and private knowledge. The Azure AI Knowledge team is leading the way to deliver the next chapter of agentic retrieval through Foundry IQ Knowledge bases to bring together many sources of structured and unstructured enterprise data and transform it into knowledge. We are continuously developing and deploying new capabilities to meet the demands of complex queries that require reasoning and reflection to deliver high quality results. Our customers span many different industries, corpus sizes and scenarios, and our work includes multiple aspects, such as: Developing LLM prompts, agents and query execution workflows, often with tight latency constraints; Collection, generation and filtering of training and evaluation data; Building off state of the art techniques from across Microsoft and the industry; Use of AI coding patterns to parallelize and accelerate experimentation.
Responsibilities
Independently incorporate state of the art research into techniques shipped to production.
Develop and build metrics to use across the full range of search engine components.
Seek out and incorporate customer feedback into dataset construction, evaluation, and technique development.
Drives technical excellence and contribute to experimentation infrastructure and proofs-of-concept using AI coding agents.
Advances the quality of the team’s experimental codebase to ensure experiments are efficient and repeatable.
Work collaboratively with product management, engineers, and other functions across products.
Drive clear and efficient plans, documents, and communication
Qualifications
Minimum
Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)OR equivalent experience.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred
Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience. 1+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping. Experience with agentic coding systems, including scaffolding for long-running agents.Experienced hybrid collaboration skills, with clear async/sync communication and teamwork. Experience defining task-specific metrics and evaluation datasets. Customer-focused and execution-driven, with strong ownership and bias for action. Experienced problem-solver, comfortable with novel, open-ended problems.