Director - AI Platform Engineering

eBay
San Jose, CA, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$240,800.0 - $321,500.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Cloud Computing Metadata Azure Machine Learning Software Deployment AI Infrastructure Pytorch Retrieval-Augmented Generation Delivery Pipeline Large Language Models Multi-Agent Systems
+4 more
AI Platforms Machine Learning Operations TensorRT Hardware Infrastructure

Job description

Join eBay as we develop a next-generation AI platform for intelligent marketplace experiences! We are seeking a Director of AI Platform Engineering to lead the infrastructure, services, and developer experiences that enable large-scale AI development and production deployment. This is an outstanding opportunity to build an ambitious AI platform that powers our global e-commerce engine.

You will drive the strategy for core capabilities spanning LLM inference, GPU infrastructure, MLOps, and agentic platforms. This role requires a proven technical leader who can scale engineering teams and collaborate with Research, Product, and Infrastructure partners., * Lead teams building production-grade LLM inference and serving platforms, including capacity planning, runtime optimization, benchmarking, release engineering, reliability, and cost efficiency.

  • Build and scale an agentic AI platform that enables teams to develop, deploy, monitor, and govern AI agents, multi-agent workflows, tool-calling systems, retrieval-augmented generation patterns, orchestration frameworks, and human-in-the-loop experiences.
  • Lead development of MLOps and AI control plane services, including model management, experiment tracking, metadata, deployment workflows, approval gates, APIs, SDKs, and self-service developer experiences.
  • Drive platform reliability and operational excellence through SLOs, observability, incident response, postmortems, production readiness reviews, automation, and capacity planning.
  • Hire, mentor, and grow a multidisciplinary engineering organization across AI infrastructure, platform services, MLOps, agentic systems, developer experience, and production operations.

Requirements

Do you have experience in Technical architecture?, * 10+ years overall experience with 5+ years of engineering leadership experience, including managing managers and/or leading multiple engineering teams.

  • Strong understanding of AI/ML platform architecture, including training, experimentation, model management, deployment, inference, observability, and developer workflows.
  • Familiarity with LLM inference, RAG systems, model serving runtimes, latency and efficiency optimization, evaluation, safety, and monitoring.
  • Ability to translate ambiguous business and research needs into clear platform strategy, technical roadmaps, operating models, and measurable execution plans.
  • Excellent communication skills, with the ability to influence senior technical, product, and executive collaborators., * Experience supporting both training and inference workloads across on-premise and cloud-based GPU environments.
  • Experience with technologies like Ray/KubeRay, vLLM, PyTorch, TensorRT, SGLang, MLflow, JupyterHub or equivalent technologies is a plus.

Benefits & conditions

Pulled from the full job description

  • Parental leave
  • Paid time off
  • RSU, The base pay range for this position is expected in the range below: $240,800 - $321,500

Base pay offered may vary depending on multiple individualized factors, including location, skills, and experience. The total compensation package for this position may also include other elements, including a target bonus and restricted stock units (as applicable) in addition to a full range of medical, financial, and/or other benefits (including 401(k) eligibility and various paid time off benefits, such as PTO and parental leave). Details of participation in these benefit plans will be provided if an employee receives an offer of employment.

If hired, employees will be in an “at-will position” and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.

Remote roles are not eligible for U.S. visa sponsorship.

About the company

At eBay, we’re more than a global ecommerce leader - we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work - every day. We’re in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers - and help us connect people and build communities to create economic opportunity for all.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:52 min

Essential phases in building and refining language models

Anshul Jindal Anshul Jindal +1 · WWC 2025

1:47 min

Comparing Egeria to alternative open metadata solutions

Ferd Scheepers · WWC 2022

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · WWC 2023

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

2:32 min

Core libraries driving inference engines and multi-GPU networking

Adolf Hohl Adolf Hohl · WWC 2024

Videos

See all

Related articles

See all