About the job
The Software Quality Operations (SWQOps) team is at the heart of ensuring the safety, reliability, and quality of the Waymo Driver. Our mission is to build an adaptable and scalable operation, increasingly powered by AI, to deliver the crucial insights necessary to confidently deploy and grow Waymo's autonomous vehicle service.
Responsibilities
Tooling Development & Optimization: Partner with Product and Engineering teams on design, test, and deployment of cutting-edge simulation tools. You will ensure these tools effectively combine human-in-the-loop (HITL) precision with AI-driven automation to create scalable test coverage.
Rapid Issue Response: Drive the technical processes for "rapid-response" simulation-based scenario testing. When emergent issues are found in the field, you will apply your deep understanding of the A/V software stack and our tooling to support root-cause evaluation and fix validation.
Policy Development: Serve as the key link between AI/ML development and operational execution. Define and document new policies, guidelines, and Standard Operating Procedures (SOPs) that integrate advanced tools and insights into daily vendor workflows.
Quality Assurance: Design and implement robust quality control processes for both human and AI-generated outputs. Perform meta-quality checks, validate the integrity of vendor work, and provide feedback to improve both human and model performance.
Technical Consultation: Act as the Subject Matter Expert (SME) for your specific domain. You will provide technical leadership to cross-functional stakeholders, advising on the feasibility of new testing coverage and driving tool improvements to achieve desired outcomes.
Qualifications
Minimum
BS/BA degree or 4 years of relevant work experience in AV Software Quality, Simulation or Technical Operations
Experience with ML testing and validation methods, including dataset quality assurance, bias detection, edge-case scenario testing, and / or performance evaluation using statistical metrics.
Ability to quickly master proprietary software tools and a proven track record of root-causing high complexity, technical issues
A strong understanding of driving rules, behavioral safety, and the nuances of complex traffic environments
Preferred
Hands-on experience with advanced AV simulation test environments
Basic experience with SQL for data extraction and basic results analysis
Experience working with offshore teams / multiple local operations hubs
Track record of using technical expertise to influence product roadmaps or improve internal customer satisfaction