Senior Data Engineer - Ingestion & Platform

traffic label
UK
3 months ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Shift work
Job source

Tech stack

Application Programming Interfaces (APIs) Airflow Automation of Tests Databases Continuous Integration Information Engineering Data Infrastructure Extract Transform Load (ETL) File Systems Github Python (Programming Language) Metadata
+10 more
OAuth Systems Integration Data Ingestion Snowflake Build Management Sendgrid Api Design Restful APIs Terraform Pagination

Job description

We are building a Customer Data Platform (CDP) that ingests data from 10+ casino partners, builds a unified player profile, and activates marketing campaigns through multiple ESPs (DotDigital, Adestra, FastTrack).

The platform is live: 5 sources in production, 30-40 dbt models in the silver layer, working email campaigns through DotDigital.

You’ll join a Data Platform team of 5-10 engineers (Senior DE, QA, DA, PM) reporting to the Data Engineering Lead. You will own the ingestion layer, source integrations, and platform tooling. Your job: make it so that connecting a new data source takes days, not months. You’ll design and build reusable pipeline templates and own integrations with external systems (both inbound and outbound).

This is not a ā€œwrite one pipeline and move onā€ role. This is ā€œbuild the system that generates pipelinesā€ + own the integrations that feed and consume data.

Why this role

Connecting a new data source currently takes 2-3 months. Your job: make it 5 days. This is a data platform engineering challenge, not a pipeline writing task.

This is the group’s flagship project. The CDP improves how the company works with players across all brands and directly generates revenue through better marketing activation.

The platform is 4 months old, modern stack, zero legacy. But already in production with real traffic, real campaigns, real money. You’re scaling a working system, not prototyping in isolation.

The core challenge is designing a system where adding a new data partner is a configuration. You’ll solve problems across the full spectrum: API design, schema evolution, orchestration patterns, data quality, and delivery to downstream consumers., * Design and build ingestion pipelines for REST API, database sources, etc., using Python

  • Own ETL and Reverse ETL end-to-end, including implementation, deployment, operations, and incident handling.
  • Understand how external systems work (casino platforms, ESPs, affiliate tools) to build reliable integrations with them.
  • Design DAG patterns: dependency management, partial retry, backfill procedures.
  • Implement and maintain authentication flows, token refresh handling, and secrets management.
  • Monitor, troubleshoot, and resolve integration issues in production environments.
  • Write and maintain automated tests to ensure the reliability and stability of integration services.
  • Collaborate closely with Engineering, Product, and Data teams to support platform scalability and operational efficiency.
  • Contribute to infrastructure improvements and Infrastructure-as-Code initiatives.
  • Write Architecture Decision Records (ADRs) for significant design choices., Data Engineer Locations Remote Europe, Remote UK Remote status Fully Remote

Requirements

Must have:

  • 6+ years in data engineering.
  • Advanced Python: API clients, file processing, schema validation, integration logic.
  • Deep Airflow experience: DAG design, dynamic generation, sensors, retry patterns, backfill, pools, connections management.
  • dbt (mid+): bronze/silver models, source freshness, tests, materialisation strategy.
  • Snowflake (mid): external stages, COPY INTO, storage integration, basic optimisation.
  • API integration experience: authentication (OAuth, API keys), pagination, rate limiting, retry with backoff, error classification.
  • Proven experience building reusable pipeline frameworks/templates that others use daily.
  • Reverse ETL or outbound integration experience: pushed data from the warehouse to external systems.
  • Writes clear documentation: architecture decisions, pipeline templates, and onboarding guides for the team.
  • CI/CD pipeline design (GitHub Actions)., * Terraform basics.
  • Metadata-driven / config-driven pipeline experience.
  • Experience with ESP platforms (DotDigital, SendGrid, Braze, or similar).
  • Gambling, marketing, or multi-tenant data platform experience.
  • Comfortable using AI coding assistants.

Benefits & conditions

  • Competitive salary.
  • Fully remote work across Europe.
  • Flexible collaboration hours and strong work-life balance.
  • The opportunity to work on scalable, business-critical systems and integrations.
  • A collaborative culture focused on ownership, innovation, and continuous improvement.

About the company

Traffic Label is an affiliate marketing group in iGaming, 18+ years in the market, 300+ clients. The group owns a crypto casino (5Bet), a CRM platform (Sway Gaming), and a marketing data subsidiary (Acrum). We build internal data products that drive player acquisition and retention across all brands.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon Ā· WWC Europe 2026

2:49 min

Adopting OAuth best practices and removing outdated grants

Alexander Schwartz Alexander Schwartz Ā· WWC Europe 2026

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters Ā· WWC 2023

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon Ā· WWC Europe 2026

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy Ā· WWC 2024

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle Ā· Coffee With Developers

Videos

See all

Related articles

See all