Data Engineer

Day in the life of a Data Engineer at MSF

You start your day with the bi-weekly operational update from the Operations department to hear what is going on in our projects, for instance in our Cholera project in Goma or vaccination campaign in South Sudan. Then it's time to get to your engineering work, after you have quick stand-up with the team.

As you will be at least coding 50% of the time that day, you can focus on our key project to migrate our Python ETL code from Azure Batch accounts to Azure Databricks. You make sure the code aligns with best practices, optimize performance and build robust error handling.

In the late afternoon you have a brainstorming about the opportunities to automate monitoring and data quality checks for other projects, and to identify a possible implementation of a ML model into production that a data scientist has created. At the end of the day, as it happens to be Thursday, you join the team for a well-earned drink!

Objectives and characteristics of the role

As a Data Engineer at MSF, you will be responsible for designing, creating and maintaining the data processing pipeline in our Azure-based Central Data Hub (CDH). You set up connections to different sources , are not afraid to dive into the complex nesting of an API response and fancy the creation of a scalable, reusable framework for data ingestion. You'll play a pivotal role in the migration to Databricks, working alongside our data platform engineer for infrastructure and analytics engineers for data modelling.

You will be part of our journey towards more (advanced) analytics and data democratisation; empowering the MSF-wide movement to do their own reporting and analytics through a Self-Service BI approach. You take colleagues along and introduce them to best practices with respect to data ingestion, SQL optimization and data modelling.

You are part of the Data & Analytics team (5 colleagues) and will work closely together with IT architects, AI developers, data security and privacy officers and our various stakeholders and data platform users all across MSF.

Main Responsibilities

• Design, build, and maintain reliable, reusable and scalable data pipelines feeding the Central Data Hub from a wide array of internal databases and external sources (including APIs)

• Ensure data quality, reliability, performance, monitoring, and documentation of pipelines and datasets

• Manage data orchestration within the central data hub to ensure timely data availability

• Translate business requirements from various MSF departments into technical designs for reliable and scalable pipelines;

• Support our move to advanced analytics by helping to operationalize and monitor machine learning models in production

• Implement and support data quality controls in line with agreed standards and governance frameworks

• Since Azure is a rapidly changing world, you will learn and stay up-to-date in the latest tools and services in the Azure ecosystem;

• Support analytics engineers and (departmental/regional) BI Analysts in using the Central Data Hub

Do you have experience in Workday?, Do you have a Master's degree?, Technical skills

• You hold a Bachelor's or Master's degree in relevant field;

• You have at least 3 years of working experience as a Data Engineer, preferably with technologies like Azure Databricks, Azure Data Factory, Azure SQL Server and Microsoft Azure Data Lake Storage;

• Strong understanding of ETL/ELT principles, datawarehousing principles and medallion architecture

• You are proficient in Python, PySpark and SQL

• You are familiar with DevOps principles and CI/CD

Soft skills

• You have experience working in Agile/ Scrum teams;

• You have the ability to coordinate between different technical teams and build consensus

• You are experienced in explaining technical topics to non-technical professionals

• You are service-oriented and demonstrate initiative with a good follow-up attitude;

• Excellent communication skills in English.

Nice to have

• You have working experience in an international environment, with daily collaboration with and within multicultural groups;

• You are certified as Databricks Data Engineer

• Familiarity with DBT

• Familiarity with data modelling

• Familiarity with Dynamics F&O and/or Workday, If you recognise yourself in this profile, we welcome you to apply directly via our website and upload a letter of motivation + Curriculum Vitae (in English) as one combined document.

This is a permanent role. We start off with a 12-month contract, with the intention of renewing based on performance.

A gross monthly salary ranging between 4,87 5 - and 6,711-euros gross per month. The exact salary depends on relevant work experience.

Main benefits:

• 30 paid vacation days annually, contingent upon full-time employment status.

• A competitive pension scheme

• 8% holiday allowance, paid out with the salary every year in May

• Commuting allowance & work from home allowance

• Hybrid working option with a minimum of 3 days in the office, based on full-time employment.

• L earning & Development has your back-with plenty of opportunities to grow your skills through exciting trainings and courses, both in-house and beyond

• Discounted daily lunch at the office

• An environment that fosters diversity, with colleagues from around the world representing various cultures and background

MSF is an international, independent medical humanitarian organization. We are a non-profit, self-governed worldwide movement of more than 63,000 people. We provide emergency medical assistance during armed conflict, natural disasters, outbreaks of deadly diseases and assist those who are excluded from healthcare. MSF delivers care based on need and when we see injustice, we speak out. We are an organization that remains impartial, knowledgeable, and effective, and this is what makes the difference between life and deat4h. People are our priority. At Médecins Sans Frontières (MSF)/ Artsen zonder Grenzen , we are committed to an inclusive culture that encourages and supports the diverse voices of our employees. We encourage diverse applicants including individuals of all gender identities, ages, sexual orientations, nationalities, races, religions, beliefs, social and marital status, people with different abilities and all other diversity characteristics and how they work together. With immediate effect, MSF OCA is currently looking for a