Data Engineer

Atolls
Charing Cross, United Kingdom
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Charing Cross, United Kingdom

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Apache HTTP Server
Google BigQuery
Code Review
Continuous Integration
Data as a Services
Directed Acyclic Graph (Directed Graphs)
Information Engineering
Data Systems
Software Debugging
Dimensional Modeling
Fault Tolerance
Python
Online Analytical Processing
Operational Databases
Ansible
SQL Databases
Data Streaming
Systems Integration
Tableau
Parquet
Business Intelligence Development Studio
Sql Optimization
Spark
Backend
GIT
Containerization
Data Lake
Kafka
Vertica
Terraform
Looker Analytics
Data Pipelines
Docker

Job description

In this role, you will:

  • Design, Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability using Python, Spark, and Clickhouse.
  • Develop and operate workflow orchestration with Apache Airflow to schedule, monitor, and manage data pipelines and transformations.
  • Manage, model and document critical data systems for analytics using SQL and dbt to support business intelligence and reporting workloads.
  • Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform components.
  • Containerize and deploy services using Docker and Kubernetes (and related tooling such as Helm).
  • Collaborate with analysts, application teams and other stakeholders to turn requirements into technical designs and delivered solutions., We review every application with equal care and will reach out if your profile aligns. Apply now with your CV in English.
  • Portfolios, writing samples, or certifications may be requested based on the role.

Requirements

We're looking for someone with data engineering experience, who is dedicated to creating exceptional user experiences and driving innovation.

Must have:

  • 4+ years building and running production data pipelines.
  • Python - strong, idiomatic, tested. You write pipelines that other people can read and easily debug.
  • SQL - advanced. Window functions, CTEs, query plans, and the instinct to know why a query got slow.
  • Data modeling & warehousing - dimensional modeling, incremental vs. full-refresh strategies, slowly changing dimensions, and the trade-offs between them.
  • dbt - building, testing, and documenting models in a real project.
  • Apache Airflow - authoring DAGs, plus the operational side: backfills, retries, SLAs, and debugging a failed run.
  • AWS - hands-on experience with S3 and the surrounding data services (Athena, Kinesis, EKS, Lambda).
  • Docker & Kubernetes - you can containerize a job and understand what happens when a pod won't schedule.
  • Git and CI/CD - branching, code review, and pipelines that gate merges.

Nice to have:

  • Knowledge of ClickHouse or another columnar OLAP engine (BigQuery, Redshift) table engines, partitioning, and MergeTree tuning are a big plus.
  • Good experience with streaming data ingestion technologies such as Kafka, Kinesis, or similar.
  • Familiarity with infrastructure as code (IaC) - Terraform, Helm, Ansible.
  • Experience with data lake architectures - Parquet, Iceberg, or Delta Lake, and an understanding of layered lake design (bronze silver gold).
  • Experience with BI tooling - Apache Superset, Looker, Tableau, or equivalent.
  • Strong experience integrating third-party APIs - handling inconsistent schemas, rate limits, and unpredictable failure modes at scale.
  • Working knowledge ofApache Spark - PySpark or Scala.

Soft skills:

  • Attention to detail - You care about correctness and you build the checks that prove it. In data engineering, a silently wrong number is worse than a loud failure.
  • Ownership - you run what you build, and you improve it when needed.
  • Clear communication - you can effectively explain in a pipeline to an analyst and a trade-off to a stakeholder.
  • Pragmatism - you can tell the difference between the right long-term design and the short-term solution, and you know when each one applies.
  • Collaboration - you work well with data engineers, analysts, and other product and backend teams.

Language requirements:

  • English - fluent, written and spoken.

Benefits & conditions

Pulled from the full job description

  • Annual leave
  • Sabbatical, At Atolls, we believe in nurturing both your professional and personal growth. Here's what you can expect:
  • A culture that values personal and professional development, with internal mobility opportunities.
  • A supportive and open-minded team that embraces diverse perspectives and innovative ideas.
  • 32 days of paid vacation plus your birthday off, giving you the time you need to recharge.
  • A flexible hybrid working scheme to balance work and life.
  • Access to a learning budget and internal training to help you grow in your role.
  • Mental health coaching to support your well-being.
  • Regular global and local get-togethers to celebrate successes and build connections.
  • The possibility of taking a sabbatical after three years with the company.
  • A cloud-based company setup, providing flexibility and collaboration opportunities no matter where you are.

About the company

Atolls is the world's largest community-driven shopping platform, active in 20+ markets. We help millions make smarter spending decisions across discovery, evaluation, and (re-)purchase by connecting people with the right brands and retailers. Our 1,000+ team across 10 countries builds products used every day at global scale, where you'll have real ownership and see your impact. Want to shape the destinations people rely on to shop with confidence? Keep reading.

Apply for this position