Data Engineer

• The candidate should have practical knowledge of DF pipelines: how they work and how they integrate with other Azure service

• The candidate should have ability to create a design and implement

• The candidate should have understanding of using a Databricks and/or Synapse Delta Lake based Staging Layer and Business Layer for BI purposes

• The candidate should understand data modelling and structural design

• Spark development

• The candidate should have practical experience in Spark and how it interacts and is used in Synapse and Databricks Notebooks

• The candidate should have knowledge about spark design, data structures and mpp flows

• The candidate should have expertise in Spark SQL and how it interacts and is used in Databricks or Synapse Notebooks

• Kafka

• Understanding of Kafka and the basics of how streaming works

• Knowledge of how to integrate Kafka with Spark and other persistence services

• Azure DevOps

• The candidate should have working experience with the CI/CD in DWH development process

• • continuous integration

• • continuous delivery / deployment

• Candidate should be able to describe tools that support automatization of testing and delivery processes

• Candidates should be able to explain the benefits and limitations of the concepts applied to the DWH development process and give examples from their own practical experience.

If you know of anyone within your network who may also be interested in this position, would you please forward this 'Email & Role' to them.

Please note:

1. That we do all we can to respond to all applications but if we have not contacted you within 2 days following your application - it's likely we have not shortlisted your cv for the position.

2. Manning Global cannot consider your application for this role if you are working for the customer we are recruiting for

3. If you are working for the client we are representing, but have confirmation you are leaving a permanent or contract position, please discuss this with us, so we can discuss representation with you.

4. This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the originator of the message. Any views expressed in this message are those of the individual sender.

Group Head Office

Manning Global AG

Hohenzollernstraße 60, 80801 Munich, Germany

Sitz der Manning Global AG: München, HRB 170058 Amtsgericht München, Vorstandsvorsitz: Rachael Manning

Munich (DE) - Dublin (IRE) - Liverpool (UK) - Zurich (CH) - Maastricht (NL)

Lille (FR) - Changzhou (CN) - New York/Houston (USA) - Zagreb (HR)