Principal Architect, Site Reliability Engineering
Role details
Job location
Tech stack
Job description
As a Principal Architect, Site Reliability Engineering for Schwab's Technology Solutions organization, you will be responsible for building a purposeful, proactive, and sustainable approach to reliability on a foundation of SRE principles. You will partner with multiple support teams, architects, developers, and other stakeholders to develop common tools and guidance and drive adoption of key reliability engineering practices in support of large-scale and mission-critical services. Through your deep SRE knowledge and history of implementation, you will have open, candid conversations with senior leaders and engineers and play a pivotal role in establishing a foundational SRE practice at Schwab.
Position Responsibilities:
- Evangelize SRE mindset and practice across the Schwab Technology Solutions organization.
- Partner with support, development, and business stakeholders to develop, measure, and leverage service level objectives.
- Design and develop solutions to eliminate toil and manual effort from day-to-day support responsibilities.
- Identify and implement improvements to logging, metrics, and tracing telemetry and triaging capabilities across a diverse technology stack.
- Lead complex triage and postmortem activities for critical issues and drive prioritization/resolution of remediation items.
- Perform chaos engineering experiments to improve application resilience to known and unknown failures.
- Document reliability guidance and best practices. Advocate for and drive adoption of said practices.
- Foster a culture of learning through coaching, mentoring, and knowledge sharing around reliability practices, processes, and tools.
- Develop tools, frameworks, and instrumentation to validate and increase release success for applications.
Requirements
Do you have experience in Triage?, * Minimum 5+ years in SRE role, with at least 3+ years in an architect or leadership position with a hands-on track record of operating mission-critical systems at scale.
- At least 3 or more years of experience designing and implementing highly scalable and fault tolerant systems.
- Deep practical expertise across observability, incident management, resilience engineering, and capacity planning, not just familiarity, but proven delivery in production environments.
- Demonstrated experience using AI tools to solve real reliability problems: anomaly detection, incident triage, noise reduction, postmortem acceleration, capacity forecasting, or auto-remediation and reduce repetitive operational toil.
- Proven ability to define and enforce technical standards across multiple engineering teams or business units without direct managerial authority.
- In-depth knowledge of resilience patterns (i.e. circuit breakers, timeouts, retries, etc.) and how to design and implement them.
- In-depth knowledge of CI/CD processes and tools to ensure software is delivered safely using known deployment strategies (i.e. blue/green, canary deployments, feature toggles, etc.).
- Authored technical postmortems with root cause analyses and documented action items that resulted in measurable resiliency improvements.
- Contributed to the SLO strategy for at least 5 teams, ensuring alignment with business and client objectives.
- Three or more years hands-on experience with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, Splunk), with a proven track record of setting up dashboards and alerts.
- Led or participated in cross-functional SRE-focused initiatives that included key stakeholders from both technical and business units.
- Participated in resilience or chaos engineering exercises, with documentation showing a reduction in unplanned downtime.
- Presented findings or led training sessions to share SRE practices, enhancing team performance or adoption rates for reliability engineering methods.
- Mentored SRE engineers and engineering teams in SRE best practices, with improvements in incident resolution speed and reliability metrics.
- Authored and maintained comprehensive SRE documentation for critical systems or workflows, including incident response guides, runbooks, operational playbooks, SLO implementation, and observability.
Benefits & conditions
3.93.9 out of 5 stars Southlake, TX Hybrid work $221,000 - $252,000 a year, Pulled from the full job description
- Tuition reimbursement
- Paid parental leave
- Employee stock purchase plan
- Parental leave
- 401(k)
- Health insurance
- 401(k) matching, We offer a competitive benefits package that takes care of the whole you - both today and in the future:
- 401(k) with company match and Employee stock purchase plan
- Paid time for vacation, volunteering, and 28-day sabbatical after every 5 years of service for eligible positions
- Paid parental leave and family building benefits
- Tuition reimbursement
- Health, dental, and vision insurance
Share: Facebook LinkedIn X Email
Eligible Schwabbies receive Medical, dental and vision benefits 401(k) and employee stock purchase plans Tuition reimbursement to keep developing your career Paid parental leave and adoption/family building benefits Sabbatical leave available after five years of employment