Lead Site Reliability Engineer

Job Description

This is a Team Lead/Manager position.

This is a full-time role in our product organization for an expert in systems design with considerable skill and expertise in large software development.  Designs and implements Continuous Integration/Continuous Deployment (CI/CD) tooling using GitHub Actions / Azure DevOps, and related technologies.  This includes defining and implementing: build and test pipelines for containerized architectures, infrastructure as code (IaC) for the stateful deployment of environments, Role-Based Access Control (RBAC), linting and other code quality controls, gitops and kubernetes pipelines, and managing SaaS deployment APIs.  

Individuals in this role will assist in the design, engineering, development, planning and administration of Azure Kubernetes AKS clusters for a set of critical business applications. This role will work closely with application, engineering, security and operations teams to engineer and build Kubernetes and Azure PaaS & IaaS solutions within an agile and modern enterprise grade operating model. Qualified applicants will have a demonstrated capability to learn new concepts quickly, and/or have robust domain expertise.    

Key Responsibilities: 

• Responsible for availability, latency, performance, efficiency, monitoring/observability, emergency response, capacity planning, setting, and maintaining SLOs, SLIs and Error Budgets, creating dashboards.  

• Analyze, troubleshoot, and resolve operational challenges contributing to defined SLO’s.  

• Manage site stability, performance, reliability, and maintain uptime for production environments.  

• Develop a fully automated multi-environment observability stack based on the existing system and extend it to predict capacity needs based on the usage patterns.  

• Strive for automation to reduce toil and increase development velocity.  

• Perform application-specific production support, incident management, change management, problem management, RCAs, and service restoration as needed.  

• Identify changes for the product architecture from the reliability, performance and availability perspective with a data driven approach.  

• Analyze and address complex technical challenges and issues that arise during the software development & run lifecycle. Debug, troubleshoot, and resolve technical problems efficiently. 

• Create and maintain technical documentation, including design specifications, user guides, run books and best practice guidelines. 

• Actively look for opportunities to improve the availability and performance of the system by applying the learnings from monitoring and observation.  

• Collaborate with software development teams in the release management process and to shape the future roadmap and establish strong operational readiness across teams.  

• Participate in Agile ceremonies, such as sprint planning, stand-up meetings, and retrospectives. 

• Collaborate with product managers, designers, and other engineers to ensure alignment and efficient project execution. 

• Share your expertise and mentor engineers, helping them grow and develop their skills. Foster a culture of continuous learning and improvement within the team. 

• Stay updated with the latest technologies, tools, and cloud computing. Proactively learn and adapt to new technologies to drive innovation. 

• Collaborate with customers to understand their needs, gather feedback, and provide technical support and guidance as needed. 

• Triage incoming Web Support escalation requests routing to applicable internal teams 

• Contribute to incident root cause analysis, service restoration, and serve as an incident commander during outage events.