About the job
The Meta Reality Labs Research Team brings together a world-class team of researchers, developers, and engineers to create the future of virtual and augmented reality, which together will become as universal and essential as smartphones and personal computers are today. And just as personal computers have done over the past 45 years, AR, VR and MR will ultimately change everything about how we work, play, and connect. We are developing all the technologies needed to enable breakthrough AR glasses and VR headsets, including optics and displays, computer vision, audio, graphics, brain-computer interfaces, haptic interaction, eye/hand/face/body tracking, perception science, and true telepresence. Some of those will advance much faster than others, but they all need to happen to enable AR, VR and MR that are so compelling that they become an integral part of our lives.
Responsibilities
Design, implement, and maintain comprehensive evaluation protocols for large language models, including both automated and human-in-the-loop assessments.
Develop and curate high-quality datasets and benchmarks to measure model performance, safety, fairness, and robustness across a variety of tasks and modalities.
Analyze model outputs to identify strengths, weaknesses, and failure modes, and provide actionable insights to research and engineering teams.
Design and implementation of novel algorithms to solve audio research problems.
Collaboration with teams building Meta’s language AI products.
Collaborate with researchers, engineers, and cross-functional partners to define evaluation goals, communicate findings, and drive improvements in model quality.
Develop tools and infrastructure to streamline and scale evaluation processes, including dashboards, annotation platforms, and reporting systems.
Stay up-to-date with the latest research in audio LLM evaluation, benchmarking, and responsible AI, and incorporate best practices into Meta’s workflows.
Disseminate evaluation results through internal reports, presentations, and, when appropriate, external publications.
Qualifications
Minimum
Currently has, or is in the process of obtaining, a PhD degree in the field of Computer Science, Artificial Intelligence, Generative AI, Transformer Models, Machine Learning, Signal Processing or Computer vision
3+ years experience with Python, Matlab, or similar
3+ years experience with machine learning software platforms such as PyTorch, TensorFlow, etc
Experience building novel audio computational models and LLM
Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
Preferred
Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. Github)
Experience in advancing AI techniques, including core contributions to open source libraries and frameworks in computer vision or audio processing
Experience with audio and speech quality assessment
Experience with multichannel audio processing
Experience in visual and acoustic scene analysis
Experience manipulating and analyzing complex, large scale, high-dimensionality data from varying sources
Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or top computer vision and machine learning conferences such as NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, ICCV, ECCV, ICASSP, InterSpeech or similar
Experience in utilizing theoretical and empirical research to solve problems
Experience working and communicating cross functionally in a team environment
Intent to return to a degree-program after the completion of the internship/co-op