Software Development Engineer - Big Data, Brand Metrics and Benchmarks

Build the AI-agent-powered data platforms that process billions of events daily to help advertisers understand what "good" looks like - sitting at the intersection of petabyte-scale data engineering, real-time distributed systems, and innovative AI agent interfaces. This isn't a team that talks about AI - we're actively shipping it into production.

We're building agent-friendly APIs that let AI systems autonomously query, interpret, and surface benchmark insights to advertisers in real time. We're deploying operational AI agents that cut incident resolution times in half, and using GenAI-driven development practices to ship faster. On the data side, our infrastructure exceeds petabyte scale with millions of transactions per second - we recently migrated our data lake to Apache Iceberg, built real-time streaming pipelines with Spark, and designed unified reporting solutions that serve both human UX and AI agent consumption patterns. Our work regularly features at Amazon Ads' unBoxed flagship conference.

What makes this role stand out:

• You'll build systems consumed by both humans and autonomous AI agents - a new paradigm in advertising data
• Petabyte-scale infrastructure with millions of transactions per second
• GenAI-accelerated development practices - from spec-driven development to autonomous testing tools
• Stable, well-built systems with reasonable on-call focused on continuous improvement, not firefighting, Design and build scalable, real-time data systems that power advertiser-facing measurement products and AI agent interfaces
• Own end-to-end delivery: requirements, design, implementation, testing, deployment, and operational support
• Build monitoring, alerting, and data quality frameworks that ensure reliability at petabyte scale
• Optimize distributed systems for performance, cost efficiency, and extensibility
• Contribute to our GenAI-accelerated development practices - from spec-driven development to autonomous testing tools
• Collaborate with scientists, product managers, and partner teams to translate complex measurement problems into elegant engineering solutions
• Navigate ambiguity and make sound technical decisions with incomplete information

About the team We're part of Measurement and Data Science (MADS) - the scientific and engineering center of excellence for campaign measurement across Amazon Advertising. Our charter is Benchmarking and Brand Metrics: we compute peer comparison insights across millions of brands worldwide and deliver them through real-time APIs, batch pipelines, and AI agent integrations. We're collaborative, technically ambitious, and value sustainable engineering.

3+ years of non-internship professional software development experience

• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 1+ years of big data technologies such as AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR or Storm/Samza experience, 4+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• 4+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling) experience
• Experience building and operating data pipelines using Apache Spark and Scala on Amazon EMR, spanning extraction, ingestion, batch and streaming processing. Data lake design with Apache Iceberg a plus.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, NY, New York - 158,100.00 - 213,800.00 USD annually