About the job
We are looking for a Senior AI Software Engineer – Agentic AI System to help build the infrastructure, tooling, and integrations that power an end-to-end evaluation platform for agentic AI frameworks. This role spans deployment orchestration, data and observability, agent framework integration, and model serving and evaluation. You will rotate across focus areas as needed, contributing where the team requires the most impact. The role emphasizes strong software engineering fundamentals, rapid learning, and curiosity about AI systems operating at scale.
Responsibilities
Design and implement deployment and orchestration workflows for distributed AI systems
Build data pipelines, observability tools, dashboards, and reporting systems
Integrate and evaluate agent frameworks and LLM-based systems
Develop tooling for model serving, benchmarking, and performance evaluation
Collaborate across teams and with external framework engineers
Qualifications
Minimum
Bachelor's degree (B.S. or B.A.) in Computer Science, Electrical Engineering, Mathematics, Statistics, or related STEM field.
In addition, you must have 5+ years of experience in the following:
Software Engineering experience
Experience with one of the languages Python/C++/TypeScript/RUST/Go
Containerized development with Docker, Linux, and command-line tooling
Experience with REST APIs and HTTP-based integrations
SQL (SQLite, PostgreSQL) for data querying
Experience with one of the following: AI agents, LLMs, or modern AI infrastructure
Preferred
Reading and navigating unfamiliar codebases quickly
AI agents, LLMs, and modern AI infrastructure
Experience with CI/CD systems (GitHub Actions, Jenkins, or similar)
Experience with SSH, remote deployments, and multi-host orchestration
Familiarity with data visualization tools (Chart.js, D3, Grafana)
Experience with model serving tools (Ollama, llama.cpp, vLLM)
Experience with prompt engineering and LLM API integrations (such as Anthropic etc.)
Familiarity with messaging platform APIs (Telegram, Slack, Discord)
Experience with infrastructure-as-code or configuration management (Ansible, Terraform)
Experience with performance profiling (memory, CPU/GPU monitoring)
Contributions to or experience with open-source agent frameworks