Engineering Manager, Site Reliability Engineering
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
We’re hiring an Engineering Managers for our Site Reliability Engineering organization to lead the team that keeps Together AI’s production infrastructure running. SRE at Together is roughly 20 engineers organized into three function areas: bare-metal / day-0 / day-2 operations, our inference platform, and our virtual clusters platform. Each function area is led by a technical lead; you’ll partner with them to manage and develop the engineers in your timezone.
This is a true player-coach role -roughly 50-60% management and 40-50% hands-on technical work. You’ll code, participate in architectural discussions, lead incident response, and stay close enough to the systems to coach effectively. You’ll also do the work that makes a team great over time: build trust, develop engineers, hire, and shape the operating rhythms that determine whether the team thrives or burns out. The honest version: the team is talented but currently stretched thin, and a major part of this role is helping them shift from reactive, manual operations to systemic, automation-first work. If that kind of leadership challenge energizes you, this is an unusually high-impact opportunity.
Together’s infrastructure isn’t a standard cloud setup- we run substantial bare-metal GPU compute, public-cloud Kubernetes for our inference platform, and Kubernetes-with-virtualization for our virtual clusters platform. You don’t need to be deep in all of it, but you do need real depth in at least one. The two EM hires will complement each other across these areas, so we’re looking at the team profile holistically., * Lead and develop a team of ~10 SRE engineers across multiple function areas, partnering with technical leads on direction.
- Drive the team’s shift from manual operations to systemic, automated, scalable infrastructure -including making toil visible, capping it, and prioritizing engineering work that reduces it.
- Stay hands-on: code, review architecture, lead incidents, and participate meaningfully in technical decisions.
- Build coaching and feedback rhythms that develop engineers over time, especially around incident leadership, on-call habits, and systemic problem-solving.
- Strengthen on-call practices and incident response, including blameless postmortems that produce real engineering follow-through.
- Partner with the other SRE EM (across timezone) to shape org-wide practices, hiring, and operational maturity.
- Help grow the team- own hiring, leveling, and career development for engineers in your region.
- Plan capacity, prioritize work across function areas in your portfolio, and represent SRE in broader engineering conversations.
Requirements
Do you have experience in Team development?, * Prior experience managing SRE, infrastructure, or platform engineering teams - ideally including time leading through a reliability or culture turnaround.
- Deep technical credibility in at least one of: bare-metal infrastructure with Ansible-based config management, Kubernetes on public cloud, or Kubernetes with virtualization.
- Strong Kubernetes and Terraform fundamentals, with hands-on production experience.
- A genuine player-coach orientation - you want to stay close to the technology and contribute as an engineer, not just review the work of others.
- Experience leading teams through serious production incidents and on-call rotations (PagerDuty or equivalent).
- A track record of coaching engineers and shifting team culture through engineering systems - not just process or frameworks. You can point to specific things you put in place and the change they produced.
- Comfort operating in a matrix structure where technical direction is shared with tech leads.
- Adaptability - the 50/50 management/IC balance shifts based on what the team needs, and you’re at home with that.
- Based in (or willing to relocate to) San Francisco, with the ability to be in the office regularly.
Benefits & conditions
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $25,0000 - $325,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
About the company
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure., Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy
You must create an Indeed account before continuing to the company website to apply
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How to Become an AI Engineer
What is Software Engineering in the Age of AI?
Dev Digest 120 - Apple and peers
Trustworthy AI Starts at Deployment: 5 Checks Before You Ship