Senior Data Engineer - Ingestion & Platform
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+10 more
Job description
We are building a Customer Data Platform (CDP) that ingests data from 10+ casino partners, builds a unified player profile, and activates marketing campaigns through multiple ESPs (DotDigital, Adestra, FastTrack).
The platform is live: 5 sources in production, 30-40 dbt models in the silver layer, working email campaigns through DotDigital.
Youāll join a Data Platform team of 5-10 engineers (Senior DE, QA, DA, PM) reporting to the Data Engineering Lead. You will own the ingestion layer, source integrations, and platform tooling. Your job: make it so that connecting a new data source takes days, not months. Youāll design and build reusable pipeline templates and own integrations with external systems (both inbound and outbound).
This is not a āwrite one pipeline and move onā role. This is ābuild the system that generates pipelinesā + own the integrations that feed and consume data.
Why this role
Connecting a new data source currently takes 2-3 months. Your job: make it 5 days. This is a data platform engineering challenge, not a pipeline writing task.
This is the groupās flagship project. The CDP improves how the company works with players across all brands and directly generates revenue through better marketing activation.
The platform is 4 months old, modern stack, zero legacy. But already in production with real traffic, real campaigns, real money. Youāre scaling a working system, not prototyping in isolation.
The core challenge is designing a system where adding a new data partner is a configuration. Youāll solve problems across the full spectrum: API design, schema evolution, orchestration patterns, data quality, and delivery to downstream consumers., * Design and build ingestion pipelines for REST API, database sources, etc., using Python
- Own ETL and Reverse ETL end-to-end, including implementation, deployment, operations, and incident handling.
- Understand how external systems work (casino platforms, ESPs, affiliate tools) to build reliable integrations with them.
- Design DAG patterns: dependency management, partial retry, backfill procedures.
- Implement and maintain authentication flows, token refresh handling, and secrets management.
- Monitor, troubleshoot, and resolve integration issues in production environments.
- Write and maintain automated tests to ensure the reliability and stability of integration services.
- Collaborate closely with Engineering, Product, and Data teams to support platform scalability and operational efficiency.
- Contribute to infrastructure improvements and Infrastructure-as-Code initiatives.
- Write Architecture Decision Records (ADRs) for significant design choices., Data Engineer Locations Remote Europe, Remote UK Remote status Fully Remote
Requirements
Must have:
- 6+ years in data engineering.
- Advanced Python: API clients, file processing, schema validation, integration logic.
- Deep Airflow experience: DAG design, dynamic generation, sensors, retry patterns, backfill, pools, connections management.
- dbt (mid+): bronze/silver models, source freshness, tests, materialisation strategy.
- Snowflake (mid): external stages, COPY INTO, storage integration, basic optimisation.
- API integration experience: authentication (OAuth, API keys), pagination, rate limiting, retry with backoff, error classification.
- Proven experience building reusable pipeline frameworks/templates that others use daily.
- Reverse ETL or outbound integration experience: pushed data from the warehouse to external systems.
- Writes clear documentation: architecture decisions, pipeline templates, and onboarding guides for the team.
- CI/CD pipeline design (GitHub Actions)., * Terraform basics.
- Metadata-driven / config-driven pipeline experience.
- Experience with ESP platforms (DotDigital, SendGrid, Braze, or similar).
- Gambling, marketing, or multi-tenant data platform experience.
- Comfortable using AI coding assistants.
Benefits & conditions
- Competitive salary.
- Fully remote work across Europe.
- Flexible collaboration hours and strong work-life balance.
- The opportunity to work on scalable, business-critical systems and integrations.
- A collaborative culture focused on ownership, innovation, and continuous improvement.
About the company
Traffic Label is an affiliate marketing group in iGaming, 18+ years in the market, 300+ clients. The group owns a crypto casino (5Bet), a CRM platform (Sway Gaming), and a marketing data subsidiary (Acrum). We build internal data products that drive player acquisition and retention across all brands.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role ā technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Analyst Salary in the UK
Software Engineer Salary London
Dev Digest 120 - Apple and peers