Data Engineer
Postaladdress
Spain
9 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.jobleads.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
5 years minimum
Working hours
Regular working hours
Languages
English
Job source
Tech stack
Airflow
BigQuery
Information Engineering
Data Systems
Python (Programming Language)
Operational Databases
Standard Sql
Parquet
Data Processing
Avro
Data Management
Data Pipelines
Job description
- Own the end-to-end pipeline that creates the unified customer_uuid across Books & Media and Fashion
- Maintain and evolve our customer identity master data with a strong focus on accuracy, reliability, and production quality
- Improve our probabilistic identity resolution model and make matching decisions measurable, transparent, and explainable
- Build scalable and cost-efficient data pipelines across BigQuery, GCS, and Cloud Run Jobs
- Introduce diagnostics, monitoring, and structured validation for every relevant model change
- Identify and resolve edge cases in customer matching logic before they become production issues
- Work closely with business and technical stakeholders to turn complex matching challenges into robust data solutions
Your Tech Stack
- BigQuery
- SQL
- Python
- Airflow
- Splink
- Google Cloud Storage
- Cloud Run Jobs
- Pub/Sub, * Contributing to a high scale, complex product and seeing the real-time impact of your work
- Flexible and hybrid working
- Private Medical Healthcare insurance
- Training budget
- Extra holidays
- Challenging tasks and professional development, knowledge & best practice sharing
Requirements
- 5+ years of experience in production data engineering
- Strong experience with BigQuery and advanced SQL in large-scale analytical environments
- Strong Python skills for production-grade data engineering
- Solid Airflow experience and a strong understanding of reliable orchestration patterns
- Hands-on experience with incremental pipelines and idempotent data processing
- Experience with probabilistic record linkage or entity resolution in production
- Strong understanding of data quality, matching logic, and precision/recall trade-offs
- A careful, structured, and ownership-driven way of working
- Strong communication skills and the ability to explain technical decisions clearly
- English Level required: B2 - Independent users of the language, i.e. those who have the necessary fluency to communicate without effort with native speakers., * Experience with Splink and probabilistic record linkage tools
- Experience with Cloud Run Jobs, GCS, and event-driven patterns in GCP
- Experience with Pub/Sub as a source in data pipelines
- Familiarity with data format trade-offs such as Parquet, Avro
- Experience with dbt
- Exposure to downstream BI use cases
- Experience in e-commerce or marketplace environments
About the company
We are a multi-award-winning team of over 100 engineers, designers, and analysts based in Leicester, with development hubs in Ukraine and Spain. We specialise in bespoke software development, extended teams/staff augmentation, and support as a service., Our partner is Europe’s leading platform for buying and selling books, CDs, movies, games, and fashion. The company fosters success by bringing together a team of professionals with diverse backgrounds who collaborate to bring bold ideas to life and find innovative solutions.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.jobleads.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
EM
Eli McGarvie
Software Engineer Salary London
about 3 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago