Sr. Manager Agentic AI / Data Software Development - DC GPU

Advanced Micro Devices, Inc.
San Jose, CA, United States
3 days ago
Apply on diversityjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$221,600.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Encodings Databases Computer Engineering Information Engineering Data Infrastructure Dataspaces Graph Database Python (Programming Language) Open Source Technology Operational Databases Software Deployment
+11 more
Software Engineering Data Streaming Large Language Models Multi-Agent Systems Data Layers Kubernetes Information Technology Data Programming Hardware Infrastructure Virtual Agents Data Pipelines

Job description

AMD’s Applied AI team works with the world’s most demanding AI operators - frontier labs, NeoCloud providers, and AI-native companies - to make AMD Instinct GPU infrastructure the easiest place to build and run AI. As an Agentic Data Engineer, you will build the data and agent systems that sit at the heart of this mission: production agentic AI applications running on AMD clusters, the data pipelines and memory/context databases that give those agents durable knowledge, and the skills frameworks and evaluation infrastructure that make agent behavior reliable, measurable, and safe.

Your work spans two surfaces. Externally, you build agentic systems and their data foundations on customer AMD deployments - the reference implementations customers adopt when they move from inference to agents. Internally, you build the Applied AI team’s own intelligence layer: engagement memory databases, fleet and telemetry data pipelines, and agent-executable skills libraries that encode deployment knowledge so every customer engagement makes the next one faster.

This is a production engineering role. The systems you build run live, get depended on, and are held to production standards for quality, provenance, and security., * Build production agentic AI systems on AMD Instinct GPU infrastructure: agent orchestration, tool/function calling (including MCP-based integrations), skills frameworks, and streaming inference integration against ROCm-based serving stacks (vLLM, SGLang)

  • Design and operate the memory and context data layer for agentic applications: vector, graph, and relational stores, embedding pipelines, retrieval and context-engineering strategies, and the freshness, provenance, and access-control policies that govern them
  • Build the Applied AI team’s engagement memory and fleet data infrastructure: pipelines that ingest deployment telemetry, incident histories, and field knowledge into structured, queryable, agent-consumable form
  • Develop and maintain the skills library: reusable, versioned, agent-executable encodings of deployment and operational expertise, with the testing and review gates required before agents or engineers rely on them
  • Build evaluation infrastructure for agentic systems: regression suites, LLM-as-judge pipelines, behavioral test harnesses, and production quality monitoring
  • Harden agentic systems against real-world failure modes, including prompt injection through retrieved context and memory stores, data poisoning, and tool-misuse paths
  • Create the reference architectures and open artifacts that make AMD the credible platform for agentic workloads, contributing upstream to the open-source agent, serving, and data ecosystem
  • Partner with customer-facing engineers on live engagements: your systems deploy into customer environments, and you support their production behavior, AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

Requirements

  • 5+ years of software engineering with significant production data engineering: pipelines, storage systems, and data quality at scale (level flexible for exceptional candidates)
  • Hands-on experience building LLM-powered and agentic applications in production: agent frameworks and orchestration, RAG and context engineering, tool calling, and multi-step workflows
  • Depth in at least one memory/context storage paradigm - vector databases, graph databases, or hybrid retrieval architectures - and informed opinions about when each is wrong
  • Experience designing evaluation frameworks for non-deterministic systems
  • Strong Python; working fluency with modern data stack tooling (orchestration, streaming, warehouse/lakehouse) and containerized deployment on Kubernetes
  • Familiarity with GPU inference serving (vLLM, SGLang, or comparable) and the performance characteristics of LLM workloads; ROCm/AMD Instinct experience a strong plus
  • Security-conscious engineering instincts, particularly around untrusted content flowing into model context
  • Open-source contribution history in the AI/ML or data infrastructure ecosystem is a plus

ACADEMIC CREDENTIALS:

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Data Engineering, or equivalent practical experience

PREFERRED ACADEMIC CREDENTIALS:

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Data Engineering, or equivalent practical experience

Benefits & conditions

$221,600.00/Yr.-$332,400.00/Yr.

About the company

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger- technologythat moves the world forward.Join us and, together, we’ll advance your career., AMD’s Data Center GPU organization is transforming the industry with our AI based Graphic Processors. Our primary objective is to design exceptional products that drive the evolution of computing experiences, serving as the cornerstone for enterprise Data Centers, (AI) Artificial Intelligence, HPC and Embedded systems.If this resonates with you, come and joining our Data Center GPU organization where we are building amazing AI powered products with amazing people.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on diversityjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

3:17 min

Optimizing character encoding with Kim variable byte encoding

Douglas Crockford Douglas Crockford · World Congress 2024

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · World Congress 2022

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

4:12 min

Distilling cross-encoder models into smaller efficient sentence embedding models

Marek Suppa · LIVE

Videos

See all

Related articles

See all