Senior Data Engineer
Role details
Job location
Tech stack
Job description
Job Description:
We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you.
Role: Senior Data Engineer Location: London Working Mode: Hybrid (3 days a week from the office, 4 days in the future) Contract Type: Inside IR35 Duration: 9-12 months Pay Rate: Market Rate
Key Responsibilities: -Build and maintain data pipelines using Informatica and Azure Databricks (Spark/Delta Lake). -Design and optimize data lake/lakehouse models, ensuring performance, reliability, and governance. -Enable BI consumption by preparing clean, curated datasets for Power BI and SAP BO. -Implement data quality rules, monitoring, and exception handling frameworks. -Collaborate with business, analytics, and technology teams to understand requirements and deliver robust data solutions. -Apply DevOps practices including Git, CI/CD, and automated testing for data pipelines. -Support creation of lightweight workflow/ops tools using Power Apps (nice to have).
Required Skills: -7+ years of experience in data engineering within enterprise environments. -Strong hands-on experience with Informatica ETL, Azure Databricks, Spark, Delta Lake, and Azure data services. -Proficiency in SQL and Python (or Scala). -Experience preparing data models and datasets for Power BI and/or SAP BO. -Practical understanding of data quality frameworks, metadata, and lineage. -Strong problem-solving, documentation, and stakeholder communication skills.
If you are interested in this position and would like to learn more, please send through your CV and we will get in touch with you as soon as possible. Please note, candidates are often Shortlisted within 48 hours.
Requirements
7+ years of experience in data engineering within enterprise environments. -Strong hands-on experience with Informatica ETL, Azure Databricks, Spark, Delta Lake, and Azure data services. -Proficiency in SQL and Python (or Scala). -Experience preparing data models and datasets for Power BI and/or SAP BO. -Practical understanding of data quality frameworks, metadata, and lineage. -Strong problem-solving, documentation, and stakeholder communication skills.