Data Engineering Principal

Metyis AG
Amsterdam, Netherlands
7 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Third Normal Form Application Programming Interfaces (APIs) Airflow Business Analytics Applications Computing Platforms Unit Testing Microsoft Azure Bash Shell Cloud Computing Continuous Integration Data Cleansing Information Engineering
+28 more
Data Governance Extract Transform Load (ETL) Data Mart Data Transformation Data Profiling Data Vault Modeling Data Visualization Data Warehousing Github Python (Programming Language) Operational Data Store Power BI Data Streaming Data Processing Scripting Sql Optimization Apache Spark Data Lakes Pyspark Integration Tests Kubernetes Information Technology Data Analytics Data Management Restful APIs Data Pipelines Serverless Computing Databricks

Job description

  • Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change
  • Become the go-to person for end-to-end data handling, management, and analytics processes.
  • Lead your team in creating the pipeline for Data management, data visualization, and analytics products, including automated services, and APIs.
  • Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization. Become part of a fast-growing international and diverse team

What you will do

  • Lead, influence & implement the technical roadmap of our clients, in light of overall technology and architecture roadmaps.
  • Be responsible for the architecture, making sure that technical and non-technical components work together in the product to deliver the customer needs.
  • Lead and Develop the digital development and operations using Python, Spark, RESTful API and Microsoft Azure Cloud, ideally with some Data Insights experience.
  • Steer the technical excellence of the application and consistency with relevant digital frameworks, best practices and standards.
  • Coach and enable other product team members to deliver best-in-class products.
  • Lead project activities and will be responsible for the evaluation of business needs and objectives, in collaboration with the project team and other stakeholders

Requirements

  • 8+ years of experience in a similar role, with experience in developing and deploying ETL solutions on Azure.
  • Solid knowledge of data warehousing principles, concepts and best practices (e.g. ODS, data marts, data lakes, data vault, 3NF).
  • Good understanding of common platforms and practices regarding digital development; Cloud based setups, Advanced Analytics and computing environments and GitHub (or similar) and CI/CD workflows.
  • Experience in setting up automated testing frameworks including unit tests, integration tests.
  • Understanding of modern cloud based architecture (Lambda & Kappa architectures).
  • Advanced SQL, data transformation and data profiling skills.
  • Experience of building production ETL/ELT pipelines at scale.
  • Data governance experience.
  • 3-5 years of hands on experience with Azure: Data factory, Databricks, Synapse (DWH), Azure Functions, App logic, and other data analytics services, including streaming.
  • Experience with Airflow, Kubernetes, Great expectations is a plus.
  • Programming languages: Python (PySpark), scripting languages like Bash.
  • Basic knowledge of PowerBI is a plus.
  • Customer centric, passionate about delivering great digital products and services.
  • Demonstrating true engineering craftsmanship mindset.
  • Passionate about continuous improvement and working collaboratively.
  • Strong problem-solving skills coupled with the ability to convey designs and ideas to a wider audience.
  • People Management experience (at least 5 team members).
  • Experience working in multiple projects.
  • Experience in service consulting and stakeholder management.
  • Project design and planning.
  • Comfortable with ambiguity, highly autonomous.
  • A Bachelor’s Degree in Computer Science, Mathematics, Economics, Engineering, Operations Research, Statistics, Business or other related technical disciplines (Master’s Degree is a plus).

About the company

Metyis is growing! We are looking for a Data Engineering Principal with 8+ years of experience for a full-time position to join our Data and Analytics team in Amsterdam., The next step of your career starts here, where you can bring your own unique mix of skills and perspectives to a fast-growing team.

Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering AI & Data, Digital Commerce, Marketing & Design solutions and Advisory services. At Metyis, our long-term partnership model brings long-lasting impact and growth to our business partners and clients through extensive execution capabilities.

With our team, you can experience a collaborative environment with highly skilled multidisciplinary experts, where everyone has room to build bigger and bolder ideas. Being part of Metyis means you can speak your mind and be creative with your knowledge. Imagine the things you can achieve with a team that encourages you to be the best version of yourself.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on nl.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all