> Markdown version of [/jobs/ext/506091-director-ai-platform-engineering](https://www.wearedevelopers.com/jobs/ext/506091-director-ai-platform-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Director - AI Platform Engineering - **Company:** eBay - **Location:** San Jose, CA, United States (Remote available) - **Experience:** Expert - **Salary:** $240,800.0 - $321,500.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Cloud Computing, Metadata, Azure Machine Learning, Software Deployment, AI Infrastructure, Pytorch, Retrieval-Augmented Generation, Delivery Pipeline, Large Language Models, Multi-Agent Systems, AI Platforms, Machine Learning Operations, TensorRT, Hardware Infrastructure - **Published:** June 11, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=134c5449d298b829 ## About the Role Do you have experience in Technical architecture?, * 10+ years overall experience with 5+ years of engineering leadership experience, including managing managers and/or leading multiple engineering teams. * Strong understanding of AI/ML platform architecture, including training, experimentation, model management, deployment, inference, observability, and developer workflows. * Familiarity with LLM inference, RAG systems, model serving runtimes, latency and efficiency optimization, evaluation, safety, and monitoring. * Ability to translate ambiguous business and research needs into clear platform strategy, technical roadmaps, operating models, and measurable execution plans. * Excellent communication skills, with the ability to influence senior technical, product, and executive collaborators., * Experience supporting both training and inference workloads across on-premise and cloud-based GPU environments. * Experience with technologies like Ray/KubeRay, vLLM, PyTorch, TensorRT, SGLang, MLflow, JupyterHub or equivalent technologies is a plus. ## Description Join eBay as we develop a next-generation AI platform for intelligent marketplace experiences! We are seeking a Director of AI Platform Engineering to lead the infrastructure, services, and developer experiences that enable large-scale AI development and production deployment. This is an outstanding opportunity to build an ambitious AI platform that powers our global e-commerce engine. You will drive the strategy for core capabilities spanning LLM inference, GPU infrastructure, MLOps, and agentic platforms. This role requires a proven technical leader who can scale engineering teams and collaborate with Research, Product, and Infrastructure partners., * Lead teams building production-grade LLM inference and serving platforms, including capacity planning, runtime optimization, benchmarking, release engineering, reliability, and cost efficiency. * Build and scale an agentic AI platform that enables teams to develop, deploy, monitor, and govern AI agents, multi-agent workflows, tool-calling systems, retrieval-augmented generation patterns, orchestration frameworks, and human-in-the-loop experiences. * Lead development of MLOps and AI control plane services, including model management, experiment tracking, metadata, deployment workflows, approval gates, APIs, SDKs, and self-service developer experiences. * Drive platform reliability and operational excellence through SLOs, observability, incident response, postmortems, production readiness reviews, automation, and capacity planning. * Hire, mentor, and grow a multidisciplinary engineering organization across AI infrastructure, platform services, MLOps, agentic systems, developer experience, and production operations. ## Related Videos - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [Developer Experience, Platform Engineering and AI powered Apps](https://www.wearedevelopers.com/videos/990-developer-experience-platform-engineering-and-ai-powered-apps) - [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)