> Markdown version of [/jobs/ext/1737279-senior-staff-backend-engineer-distributed-system](https://www.wearedevelopers.com/jobs/ext/1737279-senior-staff-backend-engineer-distributed-system). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior/Staff Backend Engineer - Distributed System - **Company:** VANHACK TECHNOLOGIES INC. - **Location:** Palo Alto, CA, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Computer Clusters, Program Optimization, Software Quality, Cursor (Graphical User Interface Elements), Linux, Distributed Systems, Python (Programming Language), Performance Tuning, AI Infrastructure, GitHub Copilot, Backend, Usage Tracking, Containerization, Kubernetes, Graphql, Front End Software Development, Api Design, Scheduling Algorithms, Docker, Crud - **Published:** July 31, 2026 - **Apply:** https://vanhack.com/job/11686 ## About the Role * Have 5+ years of backend engineering experience in distributed systems * Are proficient in Go, Python, or similar backend languages * Have experience with resource scheduling, orchestration, and API design (REST, GraphQL, gRPC) * Understand hardware constraints and system optimization * Have Linux systems and containerization experience (Docker, Kubernetes) * Are comfortable working with expensive resources where efficiency impacts costs * Are excited to solve novel problems in AI infrastructure (beyond CRUD apps) * Bring a startup mindset-comfortable with ambiguity and rapid iteration Bonus qualifications * Experience with GPU or HPC cluster management * Familiarity with ML/AI workload patterns and requirements * Experience with high-value resource allocation systems * Background in performance optimization for compute-intensive workloads * Knowledge of GPU virtualization and sharing technologies * Experience building billing or metering systems, * Hybrid role: 3 days in office, 2 days WFH; must be located in Palo Alto * Applicants must be authorized to work in the United States without visa sponsorship ## Description Our hiring partner is looking for a Backend Engineer to build the systems that orchestrate GPU clusters for AI workloads. You'll develop APIs that manage GPU allocation, memory, compute scheduling, and multi-tenant isolation-challenges unique to AI infrastructure that go far beyond standard backend engineering. On their backend team, you'll tackle questions like: How can high-cost GPU resources be efficiently shared among users? How do we handle memory constraints for large AI models? How do we maintain quality of service when workloads compete for compute? This is an opportunity to build infrastructure where every API call could allocate thousands of dollars of compute per hour, and where your optimizations directly influence whether AI startups can train their models affordably. What you'll do * Design APIs that simplify complex GPU operations for developers * Build scheduling algorithms that maximize GPU utilization while meeting SLAs * Develop systems to manage the full GPU lifecycle: provisioning, allocation, scheduling, and release * Implement usage tracking and billing for GPU-hours, memory, and compute utilization * Create monitoring solutions for GPU-specific metrics, health checks, and automated recovery * Build multi-tenant systems with resource isolation, quota management, and fair scheduling * Optimize cold starts for model serving and efficient model loading * Collaborate with frontend engineers to expose complex infrastructure through intuitive interfaces * Leverage AI-assisted coding tools (GitHub Copilot, Claude Code, Cursor IDE, etc.) to enhance productivity and code quality ## Related Videos - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Rest API Antipatterns](https://www.wearedevelopers.com/videos/100208-rest-api-antipatterns) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Top 6 Hackathons for Developers in 2023](https://www.wearedevelopers.com/magazine/263-top-6-hackathons-for-developers-in-2023) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)