Software Engineer, Chrome AI Test Infrastructure

Google
San Francisco, CA, USA

About the job

Our team manages the testing infrastructure for Chrome’s AI features, while providing the tooling necessary to evaluate and optimize the underlying models. In this role, you will scale the testing and evaluation infrastructure for Gemini in Chrome. You will empower the team to build an autonomous, task-oriented agent directly within the browser. You will be responsible for developing the "source of truth" for the project—an end-to-end evaluation suite used to gate releases, benchmark model quality, and provide deep debugging insights for the broader engineering organization.

Responsibilities

Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.

Gain a deep understanding of the AI testing and evaluation infrastructure for Chrome.

Apply debugging and creative thinking skills to find ways to address infrastructure problems in a new and expanding space.

Review code developed by other engineers and provide feedback to ensure best practices.

Qualifications

Minimum

Bachelor’s degree or equivalent practical experience.

2 years of experience with software development in Python.

2 years of experience with test infrastructure and internal tooling development.

2 years of experience with developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture.

Preferred

Master's degree or PhD in Computer Science or related technical fields.

2 years of experience with data structures and algorithms.

2 years of working within Generative AI or Agentic AI technologies.

Experience developing accessible technologies.