Software Engineer – AI Agents

FriendliAI
San Francisco2026-04-15Hybrid

About the job

We’re seeking an Agent Engineer to design and build agentic features in our platform, including document understanding, advanced RAG, and customer support automation. In this role, you will develop not only the agent components themselves, but also the Friendli Agent API, which serves as the core developer interface for building and extending agent applications. You will also build agent applications as production-ready examples of how agents can solve real-world problems.

Responsibilities

Design, build, and maintain agent APIs and applications that deliver document understanding and other high-value features

Evaluate and integrate open-source models to power production-ready agent features where possible

Develop reference agent applications to showcase workflows and accelerate customer adoption

Collaborate with backend and infrastructure teams to integrate agents with deployment, orchestration, and monitoring systems

Ensure APIs are robust, developer-friendly, and enterprise-ready through strong design principles and documentation

Continuously improve the reliability, scalability, and performance of agent features in production

Qualifications

Minimum

3+ years of experience in software engineering, preferably in backend, ML systems, or API development

Bachelor’s or Master's degree in Computer Science, Computer Engineering, or equivalent

Strong programming skills in Python; experience with various Python frameworks

Solid understanding of LLM workflows, agent patterns, or tool invocation systems

Experience designing and delivering production APIs

Familiarity with open-source LLMs and multimodal models (HuggingFace, LangChain, LlamaIndex, etc.)

Strong foundations in cloud-native development

Preferred

Experience with document understanding pipelines (e.g., OCR, RAG, summarization, structured extraction)

Familiarity with Kubernetes or container orchestration in production

Built or contributed to agent frameworks, SDKs, or CLIs

Have worked in a startup or fast-paced environments with ownership and ambiguity

Passion for developer experience and enabling AI adoption