Data Engineer - LONDON
Reed
Charing Cross, United Kingdom
yesterday
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Charing Cross, United Kingdom
Tech stack
Artificial Intelligence
Data analysis
Automation of Tests
Google BigQuery
Continuous Integration
Data Validation
Data Governance
ETL
Data Systems
DevOps
Data Flow Control
Python
Scala
SQL Databases
Google Cloud Platform
Data Strategy
Build Management
Machine Learning Operations
Data Delivery
Data Pipelines
Job description
Join Reed Professional Services, a leading Management Consultancy and technology services provider, as a Data Engineer. This role involves supporting a prestigious client on their Data Strategy programme. You will play a key role in designing and building scalable, resilient data pipelines on Google Cloud Platform, enhancing data delivery across multiple product teams.
Day-to-day of the role:
- Design and build scalable, resilient, reusable data pipeline templates across various domains.
- Standardise ingestion and transformation patterns using configuration-driven frameworks.
- Implement data quality checks including schema validation, completeness, and automated alerting.
- Enhance pipeline resilience, monitoring, observability, and recovery mechanisms.
- Integrate AI/ML features to improve reliability and operational efficiency.
- Collaborate with Data Product teams, Analytics Engineering, and Data Science to deliver production-grade data solutions.
- Ensure pipelines are documented, production-ready, and transition smoothly to BAU operations.
Requirements
- Proficiency in Python, Scala, and SQL.
- Extensive experience in data modelling and ELT/ETL processes.
- Strong experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, and Composer.
- Familiarity with CI/CD & DevOps practices, including automated testing and infrastructure as code.
- Experience in implementing data quality frameworks and production monitoring patterns.
- Proven ability to deliver within enterprise data transformation programmes with stringent SLAs.
Preferred Experience:
- Building reusable data pipeline templates for large-scale, multi-domain platforms.
- Implementing data quality management at scale.
- Experience with AI-enabled pipeline capabilities and MLOps.
Benefits & conditions
- Opportunity to work with a historic and leading UK organisation.
- Exposure to advanced technologies and enterprise-scale data projects.