About the job
xAI is seeking experienced software engineers to create robust data pipelines, comprehensive evaluations for benchmarking LLMs, and automation frameworks to increase the productivity of researchers and engineers.
Responsibilities
Creating and maintaining frameworks for agent, data, and model evaluation tasks.
Building environments for AI agents.
Tools for automating common workflows.
Improving alerts, metrics and error handling on large scale RL jobs.
Refactoring existing agent, data, eval, training frameworks for better modularity.
Designing operation procedures and coding standards to streamline the transition from small scale experimentation to large scale RL training.\nWriting unit tests, CI/CD frameworks to support rapid development cycles.
Qualifications
Minimum
Experience building and maintaining frameworks that are used by many engineers.
Experience in building high-performance sandboxes, virtual machines, and simulations.
Experience building full-stack apps for automating workflows and data visualization.
Experience in rapid iteration of research to production cycles.
Experience in test automation, CI/CD.
Preferred
No preferred qualifications listed.