Data Engineer, Agentic Data Platform, Partner Data And Analytics

Amazon.com, Inc.
United States
1 day ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

C (Programming Language) Java (Programming Language) Artificial Intelligence Amazon S3 C++ (Programming Language) Data as a Services Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Systems Identity and Access Management Python (Programming Language)
+17 more
Windows PowerShell Regression Testing Ruby DataOps SQL Databases Scripting Large Language Models Electronic Medical Records Agentic-AI Data Layers AWS Glue Data Analytics Apache Kafka Graphql Spark Streaming Api Design Amazon Redshift

Job description

We are looking for a Data Engineer to join our Agentic Data Platform team and help build the next generation of Amazon’s Partner analytics infrastructure. You will work at the intersection of large-scale data engineering and agentic AI - designing systems that power 4,000+ standardized metrics daily, serve 900K+ Selling Partners and 30K+ Amazonians, and enable AI-driven automation across the Parter ecosystem of tools and products., 1) You will build the foundational data layer that agentic systems depend on - schema-aware, version-controlled, and optimized for programmatic access.

2) You will engineer event-driven pipelines (Spark Structured Streaming, Kafka, Kinesis) that serve as the nervous system for agentic workflows - providing the low-latency data feeds that agents consume to trigger actions, detect anomalies, and orchestrate downstream processes.

3) You will define how agents discover data, resolve ambiguity across metric definitions, and compose multi-step analytical queries against our Curated Data Layer (CDL).

4) You will build intelligent agents that own the full DataOps loop: auto-detecting schema drift, self-healing broken pipelines, orchestrating metric onboarding workflows, running data quality checks, and publishing validated datasets - all with minimal human intervention.

5) You will design the trust layer for agentic data systems: output validation agents that verify SQL correctness before execution, confidence scoring for AI-generated metric definitions, automated regression testing against known-good baselines, and escalation workflows that route low-confidence outputs to human reviewers.

6) You will lead the transformation from static, manually-maintained pipelines to agent-operated infrastructure - migrating legacy ETL to Iceberg-based incremental processing, unifying metric definitions across 12+ surfaces through agent-driven reconciliation, and building the operational backbone that enables 4,000+ metrics to be governed, published, and consumed by both humans and AI agents.

Requirements

  • 3+ years of data engineering experience
  • 4+ years of SQL experience
  • Experience with data modeling, warehousing and building ETL pipelines
  • Experience building large-scale, high-throughput, 24x7 data systems
  • Experience coding, scripting, automating in at least one language (e.g., Python, C, C++, Java, Ruby, or PowerShell)

Preferred Qualifications

  • Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
  • Familiarity with API design patterns (REST, GraphQL, or MCP) for exposing data services to downstream applications, including GenAI agents and LLM-powered systems

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Loading talks and stories from around this role…