About the job
As a Machine Learning Performance Engineer, you will play a critical role in ensuring the efficiency and scalability of Siri's machine learning models. You will work closely with diverse teams to diagnose performance issues and develop innovative solutions that enhance model performance. Your expertise will be pivotal in shaping the future of Siri's AI capabilities.
Responsibilities
Analyze and optimize the performance of machine learning models and systems used by Siri.
Develop and implement strategies for model tuning, parameter optimization, and efficient resource usage.
Conduct performance benchmarking and develop tooling and metrics to measure model performance in terms of compute, memory and latency.
Collaborate with feature and product teams to consult on modeling decisions to achieve Siri performance objectives.
Collaborate with hardware and software teams to integrate research findings into product implementation.
Qualifications
Minimum
Understanding of Transformer and LLM architectures.
Strong understanding of Operating System, Compiler and Computer Architecture fundamentals. Expertise in optimizing software for take advantage of underlying hardware architecture.
Experience in analyzing, identifying, and optimizing performance bottlenecks.
Bachelors degree in Computer Science, Engineering, or related discipline, or 10+ equivalent industry experience
Preferred
Strong plus if you have expertise in optimizing model architectures for on device inference.
Strong plus if you have previously worked with modeling pipeline teams in model deployment and promotion pipelines.
Creative, collaborative, and product-focused.
Excellent communication skills
PhD in related field