> Markdown version of [/jobs/ext/240665-senior-engineer-inference-data-plane](https://www.wearedevelopers.com/jobs/ext/240665-senior-engineer-inference-data-plane). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Engineer: Inference Data Plane - **Company:** DigitalOcean, LLC - **Location:** Boston, MA, United States (Remote available) - **Experience:** Expert - **Salary:** $139,200.0 - $174,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Cloud Computing, Cloud Storage, Computer Networks, Databases, Distributed Systems, Ethernet, Python (Programming Language), Enterprise Messaging Systems, Network Control, Network Protocols, Open Source Technology, Remote Direct Memory Access, Cloud Services, Digitalocean, Software Engineering, Systems Integration, Virtual Local Area Networks, Load Balancing, Large Language Models, Containerization, AI Platforms, Kubernetes, Infrastructure Automation Frameworks, Free and Open-Source Software, Golang - **Published:** May 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=521d205851039a06 ## About the Role * Distributed Systems Mastery: Deep experience with distributed and cloud services, including messaging systems, databases, and infrastructure as code, observability, and security. * Cloud Infrastructure Expertise: Advanced knowledge of cloud networking (VPCs, Load Balancers), containerization (Kubernetes), and cloud storage (block, object, NFS). Deep networking software experience (VLAN, RDMA, Ethernet, L3-L7 network protocols, etc) would be a plus. * AI/ML Domain Knowledge: Proven experience building AI/ML products, specifically focusing on Gen AI platforms, LLM hosting, and inference workflows. * Operational Track Record: Significant experience running customer-facing, high-availability services across multiple regions. * Open Source Engagement: Experience integrating and building with open-source software and a bias for technical ownership. * Software Engineering: Expert proficiency in GoLang or Python and familiarity with gRPC for service-to-service communication. ## Description We are seeking a Senior Engineer 2 to play a key role in our AI Infrastructure Control Plane team. This team's mission is to orchestrate and operate compute fleet, storage and networking for running AI workloads - inference, training, fine-tuning - at scale. In this high-impact role, you will be a primary technical architect and leader, responsible for building the foundational control plane services that power our large Gen AI model hosting infrastructure., * Architectural Leadership: Drive the design and development of distributed services within our AI Infrastructure ecosystem, including complex orchestration for LLM inference and hosting services. Your focus will be the control plane orchestration of compute, networking, and storage for AI workloads. * System Design: Create, refine, and assess system design proposals for our high-scale, multi-tenant inference cloud ecosystem, ensuring they meet rigorous standards for availability and resiliency. * Operational Excellence: Lead the operational strategy for critical services, defining SLOs and leveraging advanced observability to maintain platform health in a high-scale environment. * Cross-Functional Collaboration: Partner deeply with Product Management, TPMs, and Engineering Management peers to align technical roadmaps with business priorities. * Strategic Growth: Work on new architecture initiatives that enable fleet optimization and help evolve DigitalOcean into a market leader for AI-native networking and infrastructure. ## Related Videos - [The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)](https://www.wearedevelopers.com/videos/2067-the-gashlycrumb-tinies-of-ai-networking-you-must-know-or-languish) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall) - [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1146-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)