Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+23 more
Job description
This role owns the technical architecture for ingesting, resolving, and maintaining very large-scale, high-cardinality identity graphs (hundreds of millions to billions of linked records) from diverse first- and third-party sources, and for integrating governed clean-room infrastructure into repeatable data products. A background in large-scale distributed data systems, identity resolution/graph data, and privacy-safe data engineering is required., * Serve as the technical owner for data pipelines supporting one or more measurement or optimization use cases
-
Architect and build scalable ETL/ELT pipelines that ingest and standardize large volumes of media, commerce, engagement, and partner data
-
Design and maintain large-scale identity graph infrastructure, including entity resolution, match/merge logic, and graph storage, that connects disparate data sources into a governed, privacy-compliant identity layer
-
Partner with Identity and Privacy teams to ensure pipelines consume Real ID and clean-room infrastructure correctly and meet consent-aware, privacy-safe requirements (e.g., GDPR and CCPA/state privacy laws)
-
Build integration patterns with walled gardens, publishers, and retail media partners to ingest exposure/outcome data at required cadence and granularity
-
Partner with Data Science to define feature pipelines and ensure data is modeled and available for measurement/optimization use cases
-
Implement data quality, lineage, and monitoring frameworks for high-volume, high-cardinality data
-
Lead architecture reviews, set engineering standards, and mentor data engineers
-
Drive continuous improvement of pipeline reliability, scalability, and cost efficiency
Requirements
-
Bachelorβs degree in Computer Science, Engineering, or a related field, plus 5+ years of data engineering experience, including ownership of large-scale pipeline or data platform architecture
-
Demonstrated experience designing and operating large-scale, distributed data pipelines
-
Strong proficiency in SQL and at least one programming language (e.g., Python, Scala, Java)
-
Experience with major cloud/data platforms (e.g., Snowflake, Databricks, AWS) and orchestration tools (e.g., Airflow)
-
Hands-on experience with entity resolution, identity graphs, or large-scale record linkage, including graph databases or graph processing frameworks (e.g., Neo4j, TigerGraph, or similar)
-
Working knowledge of privacy-safe data engineering practices and clean room environments
-
Strong communication and stakeholder-management skills, with the ability to explain architecture choices to technical and business audiences
Preferred
-
Experience productizing data pipelines from bespoke or professional-services work into standardized, repeatable data products
-
Practical experience in AdTech/MarTech or data-driven product ecosystems
-
Familiarity with partner/API integration patterns for walled gardens, DSPs, SSPs, or retail media networks (e.g., Meta, Amazon Marketing Cloud (AMC), Google, The Trade Desk)
-
Experience with streaming data platforms (e.g., Kafka, Kinesis)
-
Experience with clean room platforms (e.g., Snowflake Data Clean Rooms, LiveRamp, InfoSum, or similar)
-
Full-stack development capability and experience designing and securing APIs (REST/GraphQL) that expose data products to internal systems, partners, and AI agents
-
Exposure to LLMs, RAG, MCP, and AI coding assistants (e.g., Claude Code, GitHub Copilot) to accelerate development, with sound practices for validating AI-generated code and agentic or AI-assisted workflows
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦