> Markdown version of [/jobs/ext/1919133-senior-software-engineer-production-engineering](https://www.wearedevelopers.com/jobs/ext/1919133-senior-software-engineer-production-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Engineer, Production Engineering - **Company:** Harvey, Inc. - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $161,300.0 - $241,900.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Cloud Computing, Programming Tools, Distributed Systems, Identity and Access Management, Key Management, Network Security, Network Architecture, Reliability Engineering, Workflow Management Systems, AI Infrastructure, Data Logging, Pulumi, Google Cloud, System Availability, Large Language Models, Multi-Cloud, HybridCloud, Kubernetes, Infrastructure Automation Frameworks, Terraform - **Published:** August 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=0ff750eb30d2753e ## About the Role * 5+ years of software, infrastructure, site reliability, or production engineering experience. * Deep experience building and operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform. * Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability. * Experience building and operating distributed systems with strong reliability, scalability, and performance characteristics. * Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi. * Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations. * Experience designing and operating observability systems, including monitoring, logging, alerting, and incident response. * Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices. * A track record of driving complex, cross-functional technical initiatives and influencing engineering decisions without relying on formal authority. * Excellent communication skills and the ability to explain technical concepts clearly to engineering partners and other stakeholders. * A systems-thinking mindset and a passion for building simple, reliable, and scalable infrastructure platforms. Nice to Have * Experience supporting AI/ML or LLM infrastructure at scale. * Experience operating GPU fleets, high-performance compute infrastructure, or large-scale capacity planning. * Experience with multi-cloud infrastructure or hybrid cloud environments. * Experience building internal platforms or developer tooling that improves engineering velocity and production safety. ## Description * Design, build, and operate the production infrastructure that powers Harvey's products and AI workloads. * Drive technical direction across compute infrastructure, networking, Kubernetes, workflow orchestration, and production operations. * Lead complex, cross-functional technical initiatives that improve reliability, scalability, security, operational efficiency, and infrastructure cost. * Partner with Product Engineering, Security, AI Infrastructure, and Platform teams to translate product and business requirements into resilient infrastructure solutions. * Establish reusable patterns, tooling, and paved paths that help engineering teams ship and operate production services safely. * Raise the engineering bar through thoughtful design reviews, clear technical documentation, operational rigor, and mentorship. Infrastructure Foundation & Production Operations * Build and operate Harvey's global compute and network infrastructure, ensuring high availability, scalability, reliability, and performance. * Improve compute utilization, performance, and service availability while supporting rapidly growing AI workloads. * Develop capacity models, demand forecasts, and fleet lifecycle automation to help infrastructure scale efficiently with business growth. * Operate and continuously improve Harvey's Kubernetes platform, including cluster provisioning, upgrades, networking, monitoring, reliability, performance, and operational automation. * Drive infrastructure cost efficiency through capacity management, resource rightsizing, workload optimization, and utilization monitoring. * Build secure infrastructure foundations, including identity and access management, network isolation, secrets management, auditing, and compliance controls. * Develop scalable Infrastructure-as-Code and automation frameworks using technologies such as Terraform and Pulumi. * Improve observability, monitoring, alerting, incident response, and operational readiness across the infrastructure platform. * Participate in the on-call rotation, lead incident response when needed, and turn production learnings into durable engineering improvements. ## Related Videos - [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Unleashing Potential Across Teams: The Power of Infrastructure as Code](https://www.wearedevelopers.com/videos/930-unleashing-potential-across-teams-the-power-of-infrastructure-as-code) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Terraform for Developers](https://www.wearedevelopers.com/videos/3-terraform-for-developers) - [Instant KAI Sandboxes with vCluster: Multi-Tenant, Multi-Scheduler GPU Sharing](https://www.wearedevelopers.com/videos/100333-instant-kai-sandboxes-with-vcluster-multi-tenant-multi-scheduler-gpu-sharing) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)