Data Engineer

Adecco
Solihull, United Kingdom
2 days ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 169K

Job location

Solihull, United Kingdom

Tech stack

Amazon Web Services (AWS)
Data analysis
Azure
Cloud Computing
Profiling
Continuous Integration
Information Engineering
Data Governance
Data Integration
ETL
Data Security
Microsoft SQL Server
Nagios
Performance Tuning
DataOps
Azure
SQL Databases
SQL Server Reporting Services
SQL Server Integration Services
Data Streaming
GIT
Data Lake
PySpark
Kubernetes
Information Technology
Bicep
Integration Frameworks
Data Management
Machine Learning Operations
Terraform
Azure
Data Pipelines
Databricks

Job description

Design, build and assure scalable, secure data products and pipelines across Azure, AWS and Databricks. Lead data integration design, technical decisions and best practices, while mentoring engineers and enabling high-quality analytics, BI and data science outcomes.

Reporting & Collaboration

  • Reports to Lead Data Engineer with oversight from Head of Data Operations & Engineering
  • Works across Data Science, Analytics, Architecture, Cyber, Product and Delivery teams
  • Acts as a senior technical lead, guiding engineers and influencing cross-team decisions, * Lead design and delivery of scalable batch & streaming data pipelines and products
  • Define and assure enterprise-aligned data integration architectures
  • Optimise cloud platforms (Azure, AWS, Databricks) for performance and cost
  • Build and own ETL/ELT pipelines using PySpark, SQL and orchestration frameworks
  • Automate and modernise legacy data processes with reusable patterns
  • Design robust data models (Delta Lake, schema evolution, metadata, lineage)
  • Ensure data security, governance, and compliance (access control, encryption, lifecycle)
  • Provide technical leadership, mentoring and design reviews
  • Collaborate with stakeholders to translate complex technical decisions clearly
  • Support strategic roadmap, tooling and continuous improvement initiatives

Core Skills & Expertise

Data Engineering

  • Advanced PySpark and SQL, performance tuning and best practice coding
  • Data modelling (conceptual, logical, physical) and integration design
  • Data quality, testing frameworks and automated validation
  • Strong data analysis, profiling and insight delivery

Cloud & Platforms

  • Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview
  • AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation
  • Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow
  • SQL Server stack (SSIS, SSRS)

Engineering Practices

  • CI/CD for data platforms and Infrastructure-as-Code (Terraform/Bicep)
  • Git, monitoring and alerting tools
  • Data governance, lineage and observability frameworks
  • Leading technical design assurance and reviews

Requirements

  • Degree (or equivalent) in Computer Science or related field
  • Experience in enterprise-scale data engineering
  • Relevant certifications (Azure, AWS, Databricks) desirable

Apply for this position