About the job
The Ads Human Evaluation program (aka "ads-ewoq") is a data labeling platform that combines LLM autoraters with humans-in-the-loop to deliver high quality labeled data at scale. The engineering team is part of the Ads ML organization. The EWOQ team leverages Human and ML modeling to generate mission-critical data labels for teams across Google. Our mission is to generate high-quality, cost-effective labelled data to ensure our ad ecosystem is trustworthy and enriches the user's experience. We are building a new Ads Evaluation platform to simplify, speed up, and improve the quality of offline evaluation for all of ads using our LLM Rater technology.
Responsibilities
Develop LLM Rater functionality for EWOQ and new Ads Evaluation platform.
Use AI tools in all aspects of software development and build scalable distributed systems.
Build high performance data processing systems.
Qualifications
Minimum
Bachelor's degree or equivalent practical experience.
8 years of experience programming in Java or C++.
8 years of experience programming in JavaScript or TypeScript.
5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
Preferred
Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
8 years of experience with data structures and algorithms.
3 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
Experience with SQL or AI Platform.