About the job
As a Software Engineer for Compute Efficiency on the Capacity team, you will play a central role in making our systems more performant, cost-effective, and sustainable—without compromising reliability or latency. You will work across the full infrastructure stack, from cloud platforms and networking to application-level performance, and will bridge the gap between high-level research needs and low-level hardware constraints to build the most efficient AI infrastructure in the world.
Responsibilities
Build and evolve telemetry and monitoring systems to provide deep visibility into infrastructure performance, utilization, and costs across our cloud and datacenter fleets.
Design and implement cost attribution frameworks for our multi-tenant infrastructure, enabling teams to understand and optimize their resource consumption.
Identify and resolve performance bottlenecks and capacity hotspots through deep analysis of distributed systems at scale.
Partner closely with cloud service providers and internal stakeholders to optimize cluster configurations, workload placement, and resource utilization across AI training and inference workloads—including large-scale clusters spanning thousands to hundreds of thousands of machines.
Develop and champion engineering practices around efficiency, driving a culture of performance awareness and cost-conscious design across Anthropic.
Collaborate with research and product teams to deeply understand their infrastructure needs, and design solutions that balance performance with cost efficiency.
Drive architectural improvements and code-level optimizations across multiple services and platforms to deliver measurable utilization and performance gains.
Qualifications
Minimum
Have 6+ years of relevant industry experience, 1+ year leading large scale, complex projects or teams as a software engineer or tech lead
Deep expertise in distributed systems at scale, with a strong focus on infrastructure reliability, scalability, and continuous improvement.
Strong proficiency in at least one programming language (e.g., Python, Rust, Go, Java)
Preferred
Experience with machine learning infrastructure workloads as well as associated networking technologies like NCCL.
Low level systems experience, for example linux kernel tuning and eBPF
Quickly understanding systems design tradeoffs, keeping track of rapidly evolving software systems
Published work in performance optimization and scaling distributed systems