AI/ML Software Development Engineer

Booz Allen Hamilton
Washington, DC2026-04-23Full time

About the job

To achieve an organization’s mission, leaders need strong team members who can create and analyze processes, communicate requirements, and develop innovative solutions throughout the execution of the mission. Whether reviewing program-wide technical architecture or providing AI/ML infrastructure expertise, our clients need someone who combines deep technical understanding of software engineering with strong architectural judgment. That is why we need you, an experienced AI/ML Software Development Engineer who can operate at a system-of-systems level to support clients in advancing AI-enabled systems within an R&D environment.

Responsibilities

Serve as Software Development Engineer to the Advanced Research Projects Agency for Health (ARPA-H), helping conceptualize, create, and execute advanced government-funded research and development programs to accelerate better health outcomes for everyone. Work with world-class scientists and engineers to support the development of high-impact solutions to society's most challenging health problems. Leverage technical expertise to provide strategic assessments of new technologies in support to senior ARPA-H decision makers. Maintain responsibility for producing and presenting findings and recommendations to a team of colleagues and clients on the feasibility and potential impact of future research programs, assisting with the management of current programs, and facilitating commercialization of successfully developed technologies. Serve as an AI/ML Infrastructure Software Engineer advising program leadership and supporting software engineering to support the client mission. Support clients in ensuring that program-wide technical architecture and engineering to rigorous AI development, evaluation, and long-term impact.

Qualifications

Minimum

3+ years of experience building and operating production-grade software systems

Experience with algorithms, data structures, distributed systems, design patterns, cloud platforms, such as Azure, AWS, or GCP, and containerization, such as Docker

Experience working in high-velocity, end-to-end delivery environments

Experience interacting and communicating with senior-level executives, including SES or GS-15

Experience with using Microsoft Office, Excel, Word, and PowerPoint

Knowledge of modern backend frameworks and asynchronous programming models

Ability to work in at least 2 backend programming languages, including Python

Preferred

Experience with LLM integration, such as tool-calling, RAG, multi-step reasoning, and context management

Experience with multi-agent orchestration and Agent-to-Agent (A2A) communication patterns

Experience with prompt engineering, model behavior differences, and LLM evaluation methods

Experience with startup environments or regulated domains such as healthcare or life sciences

Experience with Microsoft Azure services, such as Azure Functions, API Management, Container Apps, or Azure OpenAI

Knowledge of token economics, cost optimization, and context budget management

Knowledge of Model Context Protocol (MCP) for tool discovery and invocation

Knowledge of security best practices, including secrets management and least-privilege access

Possession of excellent oral and written communication skills