Software Development Engineer, AI Core Infra - AI Analytics and Insights

Amazon
USA, WA, SEATTLE2026-04-30ONSITE

About the job

As an SDE II on this team, you will be at the center of designing, building, and scaling the systems that power this conversational AI experience. You will architect robust backend services, build reliable integrations with large language models (LLMs), develop retrieval-augmented generation (RAG) pipelines, and engineer the feedback loops that allow our system to continuously evaluate and improve itself. You will work alongside applied scientists, product managers, and fellow engineers in a fast-paced, high-ownership environment where your contributions directly shape the product and influence how thousands of internal customers interact with data.

Responsibilities

Design and build scalable services that power SpektrBot's conversational AI platform, including query orchestration, context management, session handling, and response generation pipelines

Engineer RAG architectures — build and optimize retrievers, vector stores, embedding pipelines, and metadata indexing systems to ensure accurate and contextually relevant data retrieval from our advertising data lake

Integrate and operationalize LLMs — build the infrastructure for prompt management, model routing, multi-agent orchestration, and chain-of-thought workflows that enable natural, multi-turn conversations

Build automated evaluation and feedback loops — design systems that continuously measure response accuracy, detect regressions, and feed corrections back into the system to drive improvement over time

Develop SQL generation and validation pipelines — engineer the end-to-end flow from natural language intent to generated SQL, including guardrails, query validation, and result verification to ensure trusted outputs

Build tooling for metadata auto-curation — create LLM-powered tools that automatically enrich, classify, and maintain the metadata catalog that underpins accurate data retrieval

Collaborate with applied scientists to productionize NLP/NLU models and integrate them into the bot's overall architecture

Own systems end-to-end — from design through deployment, monitoring, alarming, and operational excellence in a production environment serving internal customers at scale

Qualifications

Minimum

3+ years of non-internship professional software development experience

2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience

1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience

1+ years of Object Oriented Design experience

Experience programming with at least one software programming language

Preferred

4+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience

Bachelor's degree in computer science or equivalent