Senior Site Reliability Engineer - Data Infrastructure (San Jose)

ByteDance
San Jose2023-10-29基础架构

About the job

The Data Infrastructure SRE team is responsible for the reliability, scalability, and efficiency of the core data services that power our products. We manage a massive, distributed environment built on technologies like Kubernetes, Redis, MySQL, and Message Queue. Our work is not about building features, but about engineering the resilience and performance of the underlying platform that all product teams depend on. We are the guardians of production, ensuring our data systems run smoothly, nonstop.

Responsibilities

- Incident response and postmortems: Act as an incident commander for critical production issues, guiding the team through triage and resolution. Drive deep, blameless post-incident reviews and ensure that follow-up actions are implemented to prevent recurrence.

- SLO/SLA and error budgets: Define, negotiate, and maintain Service Level Objectives (SLOs) for critical data services. Champion the use of error budgets to balance reliability work with feature development.

- Capacity and cost optimization: Lead initiatives in capacity planning, performance tuning, and resource management. Develop strategies and automation to ensure our infrastructure scales efficiently and stays within budget.

- Pragmatic automation and AI orchestration: Design and build automation and leverage AI Agents to eliminate operational toil, improve deployment safety, and enhance overall operational efficiency. Focus on creating maintainable, robust tools and intelligent workflows that make the entire team more effective.

- Operational excellence and change management: Uphold and improve our standards for production operations, including runbooks, monitoring, and alerting. Vet complex changes and deployments to ensure they meet our bar for production readiness.

- Data Center and AI Infrastructure: Lead the construction, maintenance, and optimization of data centers and specialized AI infrastructure, ensuring high availability and peak performance for complex AI-driven workloads.

- Cross-team influence and mentorship: Act as a subject matter expert on reliability, consulting with application development and other infrastructure teams. Mentor junior SREs, helping them develop their technical and operational skills.

Qualifications

Minimum

- Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.

- 5+ years of experience in a Site Reliability Engineering, Production Engineering, or similar role.

- Strong proficiency in a programming or scripting language (e.g., Go, Python, Bash) for automation and tool development.

- Deep understanding of Linux/Unix operating systems, networking fundamentals (TCP/IP, DNS), and distributed systems.

Preferred

- Extensive hands-on experience managing large-scale data infrastructure (e.g., MySQL, Redis, Kafka, Flink).

- Proven experience with container orchestration technologies, particularly Kubernetes, in a production environment.

- Expertise in designing, analyzing, and troubleshooting large-scale distributed systems.

- A systematic problem-solving approach, coupled with strong communication skills and a sense of ownership.

- Experience leading incident response for complex, high-impact events.

- Experience in the operation and construction of Data Centers is a big plus.