> Markdown version of [/jobs/ext/2540143-software-engineer-cloud-infrastructure](https://www.wearedevelopers.com/jobs/ext/2540143-software-engineer-cloud-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer - Cloud Infrastructure - **Company:** FriendliAI Corp. - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Cloud Computing, Computer Programming, Computer Networks, Computer Engineering, Network Congestion, Software Debugging, Distributed Systems, Domain Name System (DNS), InfiniBand, Python (Programming Language), Network Troubleshooting, Network Service, Remote Direct Memory Access, Ansible, Load Balancing, Istio, Multi-Cloud, HybridCloud, Amazon Virtual Private Cloud (VPC), Kubernetes, Information Technology, Terraform - **Published:** August 12, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=ea7efea2ba71b685 ## About the Role * 5+ years designing, building, and operating large-scale Kubernetes infrastructure in production. * Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent. * Proven experience operating large-scale, high-traffic network services in production. * Deep understanding of Kubernetes internals: API server, scheduler, controller loops, kubelet, and etcd. * Strong command of Kubernetes and cloud networking: CNI, kube-proxy/eBPF datapaths, DNS, load balancing, service mesh, and VPC routing. * Proficiency with AWS, Terraform, Helm, and Ansible. * Programming skills in Go or Python, with the ability to build infrastructure tooling and automation. * Strong debugging skills across distributed systems, containers, and the Linux networking stack. * Clear written and verbal communication, including the ability to document architectural decisions for other engineers., * Large-scale Kubernetes operations in a high-traffic domain such as gaming, e-commerce, or public cloud. * Cilium and eBPF, including kube-proxy replacement or upstream contributions. * Cluster provisioning and lifecycle management with Kubespray or similar Ansible-based tooling. * GPU orchestration: NVIDIA GPU Operator, device plugins, or Dynamic Resource Allocation (DRA). * High-performance networking for distributed workloads: RDMA/RoCE, InfiniBand, EFA, SR-IOV, or NCCL tuning. * Multi-cloud, hybrid-cloud, or bare-metal Kubernetes operations. * Contributions to Kubernetes, Cilium, Istio, or other CNCF projects. ## Description Cluster Architecture * Own the architecture of our multi-cluster, multi-tenant Kubernetes fleet across both managed and self-managed clusters: cluster topology, control plane and etcd lifecycle, and zero-downtime upgrades. * Extend Kubernetes with custom controllers, operators, and CRDs so platform behavior is encoded in software rather than runbooks. * Design GPU scheduling and capacity strategy, including topology-aware placement, node pools, priority and preemption, and quota across tenants. * Build autoscaling that matches inference traffic: queue-driven pod scaling, node autoscaling, scale-to-zero, and cold-start reduction. Networking * Own the Kubernetes network data plane: CNI, IPAM, DNS, ingress, and L4/L7 load balancing. * Design cross-AZ, cross-region, and cross-cluster connectivity, and operate the service mesh for routing, mTLS, and traffic policy. * Debug production network issues (packet loss, conntrack exhaustion, MTU mismatches, DNS latency, load balancer behavior) and drive permanent fixes. Reliability & Collaboration * Define SLOs for platform-critical systems and lead post-incident hardening. * Deliver infrastructure as code with Terraform, Helm, and GitOps. * Partner with the inference engine, platform, SRE, and security teams to turn serving requirements into platform capabilities. ## Related Videos - [Dev & Test in the Cloud? Deploy your cloud environments with Ansible & Terraform](https://www.wearedevelopers.com/videos/1607-dev-test-in-the-cloud-deploy-your-cloud-environments-with-ansible-terraform) - [Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬](https://www.wearedevelopers.com/videos/100355-running-secure-life-science-research-at-scale-using-hybrid-gpu-hpc-and-kubernetes) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Rate-limiting using eBPF and Istio: How to protect your SaaS customers from themselves](https://www.wearedevelopers.com/videos/100220-rate-limiting-using-ebpf-and-istio-how-to-protect-your-saas-customers-from-themselves) - [Terraform for Developers](https://www.wearedevelopers.com/videos/3-terraform-for-developers) - [Embracing the Hybrid Cloud: Unlocking Success with Ansible](https://www.wearedevelopers.com/videos/932-embracing-the-hybrid-cloud-unlocking-success-with-ansible) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [The Best X (Twitter) Accounts for Developers](https://www.wearedevelopers.com/magazine/294-the-best-x-twitter-accounts-for-developers)