About the job
Meta is seeking a Research Engineering Manager to lead the Evaluations team within Meta Superintelligence Labs. Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. In this leadership role, you will guide a team of research engineers who curate and build the benchmarks for our most advanced AI models, across text, vision, audio, and beyond. You'll partner with world-class researchers and engineers to define the strategic vision for evaluation infrastructure, while ensuring your team delivers high-quality, scalable benchmarks and reinforcement learning environments.
Responsibilities
Team Leadership & Management
Build, mentor, and grow a team of research engineers and scientists focused on evaluation infrastructure and benchmarking
Conduct performance reviews, career development conversations, and provide technical mentorship to team members
Foster a culture of engineering excellence, research rigor, and rapid iteration within the team
Partner with recruiting to hire world-class research engineering talent
Technical Strategy & Execution
Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development
Oversee the development and implementation of evaluation environments, including environments for novel model capabilities and modalities
Establish partnerships with external data vendors to source and prepare high-quality evaluation datasets
Influence the technical roadmap for evaluation infrastructure in collaboration with MSL Infra team
Translate the technical vision of research scientists into actionable engineering plans and execution strategies
Cross-Functional Collaboration
Partner with research scientists, product teams, and other engineering teams to align evaluation priorities with organizational goals
Build robust, reusable evaluation pipelines that scale across multiple model lines and product areas
Drive the development of evaluation tooling that measures the quality and reliability of evaluation suites
Communicate technical progress, challenges, and strategic decisions to leadership
Hands-On Technical Contribution
Maintain technical credibility through hands-on contributions to critical evaluation projects (20-30% of time)
Review code, provide technical guidance, and unblock complex technical challenges
Set engineering standards and best practices for the team
Follow best software engineering practices including version control, testing, code review, and system design
Qualifications
Minimum
Bachelor's or Master's degree in Computer Science, Machine Learning, or a related technical field
4+ years of experience in machine learning engineering, machine learning research, or a related technical role
3+ years of experience managing or leading technical teams, including hiring, mentoring, and performance management
Proficiency in Python and experience with ML frameworks such as PyTorch
Proven track record of leading medium to large-scale technical projects from conception to deployment
Demonstrated experience balancing hands-on technical work with people management and strategic planning
Clear communication and experience influencing cross-functional stakeholders
Preferred
Publications at peer-reviewed venues (NeurIPS, ICML, ICLR, ACL, EMNLP, or similar) related to language model evaluation, benchmarking, or deep learning
Hands-on experience with language model post-training and deep learning systems, or building reinforcement learning environments
Experience implementing or developing evaluation benchmarks for large language models and multimodal models (e.g., vision-language, audio, video)
Experience building and scaling large-scale distributed systems and data pipelines
Familiarity with language model evaluation frameworks and metrics
Track record of open-source contributions to ML evaluation tools or benchmarks
Experience managing teams in fast-paced research or startup environments
PhD in Computer Science, Machine Learning, or related field