Senior Data Engineer

ETeam Inc
Charing Cross, United Kingdom
2 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Charing Cross, United Kingdom

Tech stack

Automation of Tests
Azure
Continuous Integration
Data as a Services
Information Engineering
ETL
Data Systems
DevOps
Python
Metadata
Power BI
SQL Databases
Spark
GIT
Data Lake
Sap Bo
Data Pipelines
Powerapps
Databricks

Job description

Job Description:

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you.

Role: Senior Data Engineer Location: London Working Mode: Hybrid (3 days a week from the office, 4 days in the future) Contract Type: Inside IR35 Duration: 9-12 months Pay Rate: Market Rate

Key Responsibilities: -Build and maintain data pipelines using Informatica and Azure Databricks (Spark/Delta Lake). -Design and optimize data lake/lakehouse models, ensuring performance, reliability, and governance. -Enable BI consumption by preparing clean, curated datasets for Power BI and SAP BO. -Implement data quality rules, monitoring, and exception handling frameworks. -Collaborate with business, analytics, and technology teams to understand requirements and deliver robust data solutions. -Apply DevOps practices including Git, CI/CD, and automated testing for data pipelines. -Support creation of lightweight workflow/ops tools using Power Apps (nice to have).

Required Skills: -7+ years of experience in data engineering within enterprise environments. -Strong hands-on experience with Informatica ETL, Azure Databricks, Spark, Delta Lake, and Azure data services. -Proficiency in SQL and Python (or Scala). -Experience preparing data models and datasets for Power BI and/or SAP BO. -Practical understanding of data quality frameworks, metadata, and lineage. -Strong problem-solving, documentation, and stakeholder communication skills.

If you are interested in this position and would like to learn more, please send through your CV and we will get in touch with you as soon as possible. Please note, candidates are often Shortlisted within 48 hours.

Requirements

7+ years of experience in data engineering within enterprise environments. -Strong hands-on experience with Informatica ETL, Azure Databricks, Spark, Delta Lake, and Azure data services. -Proficiency in SQL and Python (or Scala). -Experience preparing data models and datasets for Power BI and/or SAP BO. -Practical understanding of data quality frameworks, metadata, and lineage. -Strong problem-solving, documentation, and stakeholder communication skills.

Apply for this position