Lead Site Reliability Engineer

We are seeking an experienced Lead Site Reliability Engineer to join our engineering team and drive the reliability, scalability, and performance of our critical systems. This role combines deep technical expertise in software engineering, cloud infrastructure, and DevOps practices to ensure our services meet the highest standards of availability and operational excellence., System Reliability & Performance

• Design, implement, and maintain highly available, scalable, and resilient systems across cloud infrastructure
• Establish and monitor SLIs, SLOs, and SLAs to ensure optimal system performance
• Lead incident response, conduct root cause analysis, and implement preventive measures
• Develop and maintain disaster recovery and business continuity plans

Infrastructure & Automation

• Architect and manage cloud infrastructure on AWS using Infrastructure as Code (Terraform)
• Automate deployment pipelines, monitoring, and operational workflows
• Optimize cloud resource utilization and cost management

Engineering & Development

• Build and maintain internal tools and services to improve operational efficiency
• Collaborate with development teams to implement reliability best practices
• Conduct code reviews and provide technical guidance on system design
• Develop monitoring solutions, alerting systems, and observability frameworks

Security & Compliance

• Integrate security practices into CI/CD pipelines (SAST/DAST)
• Implement and maintain security controls across infrastructure and applications
• Ensure compliance with industry standards and regulatory requirements
• Conduct security assessments and vulnerability management

Leadership & Collaboration

• Mentor junior SRE team members and promote SRE culture across the organization
• Partner with software engineering teams to improve system reliability
• Drive technical initiatives and contribute to architectural decisions
• Document processes, runbooks, and technical specifications

• Strong proficiency in Java, Python, and Node.js
• Experience with microservices architecture and distributed systems
• Solid understanding of data structures, algorithms, and design patterns
• Proficiency in writing clean, maintainable, and testable code

Cloud Infrastructure (AWS):

• Extensive experience with AWS services including:
• Compute: Lambda, ECS, EC2, Fargate
• Storage: S3, EBS, EFS
• Database: RDS, DynamoDB, Aurora
• Networking: VPC, Route53, CloudFront, API Gateway
• Monitoring: CloudWatch, X-Ray
• AWS certifications (Solutions Architect, DevOps Engineer) preferred

DevOps & CI/CD:

• Expert-level knowledge of GitLab (CI/CD pipelines, runners, GitOps)
• Advanced Terraform skills for infrastructure provisioning and management
• Experience with containerization (Docker) and orchestration (Kubernetes/ECS)
• Proficiency with configuration management tools

Security:

• Hands-on experience with SAST (Static Application Security Testing) tools
• Knowledge of DAST (Dynamic Application Security Testing) methodologies
• Understanding of security best practices, OWASP Top 10, and compliance frameworks
• Experience with secrets management and identity access management (IAM)

Monitoring & Observability:

• Experience with monitoring tools (Grafana, Datadog, New Relic, or similar)
• Log aggregation and analysis (CloudWatch Logs, Splunk)
• Distributed tracing with aws X-Ray, * Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent practical experience
• 7+ years of experience in Site Reliability Engineering, DevOps, or related roles
• 3+ years in a lead or senior technical position
• Proven track record of managing large-scale production systems
• Experience with on-call rotations and incident management
• GenAI based Applications: Working knowledge of LLMs and agentic applications a plus
• Experience with serverless architectures and event-driven systems
• Familiarity with chaos engineering principles and practices
• Background in Agile/Scrum methodologies
• Experience with multi-cloud or hybrid cloud environments

The selected candidate will reside within a reasonable commuting distance, as defined by the employing Reserve Bank, and will work full-time onsite.

• Eligible Locations for Hire: Richmond, VA, San Francisco, CA
• The following Reserve Bank locations are preferred due to the concentration of System IT team members in these locations: San Francisco, and Richmond, VA

Base Salary Range: Min: $146,700 Mid: $190,500 Max: $234,300 (Location: San Francisco), Agile Programming Methodologies, Algorithms, Amazon Web Services (AWS), Analysis Skills, Applications Security, Architectural Services, Automation, Best Practices, Business Continuity Planning (BCP), Cloud Architecture, Cloud Computing, Code Reviews, Computer Science, Computer Security, Configuration Management, Continuous Deployment/Delivery, Continuous Integration, Cost Control, Data Structures, Design Patterns Programming Methodologies, DevOps, Disaster Recovery, Distributed Computing, Docker, Emerging Technology, Financial Systems, High Availability, Hybrid Cloud, Identity Data Management, Incident Management, Incident Response, Industry Standards, Information Technology & Information Systems, Interviewing Skills, Java, Large-Scale Systems, Leadership, Maintain Compliance, Mentoring, Microservices, Node.js, On Call, Operational Improvement, Operational Strategy, Production Systems, Python Programming/Scripting Language, Radiography, Regulatory Requirements, Reliability Engineering, Resource Utilization, Root Cause Analysis, Scrum Project Management and Software Development, Security Analysis, Security Infrastructure, Service Level Agreement (SLA), Software Engineering, Software Testing, Splunk, Systems Engineering, Systems Reliability, Systems Scalability, Technical Leadership, Test Tools

Federal Reserve Bank of San Francisco

When you join the Federal Reserve-the nation’’s central bank-you’ll play a key role, collaborating with leading tech professionals to strengthen and protect our economic, financial and payments systems. We invest in contemporary and emerging technology each year to support the Federal Reserve and our economy, and we’re building a dynamic and diverse team for our future.