Data Engineer

LEVY PROFESSIONALS
Amersfoort, Netherlands
17 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Microsoft Azure Continuous Integration Python (Programming Language) Object-Oriented Software Development Scrum Methodology Cloud Services SQL Databases Data Streaming Azure Data Factory Git Build Management
+7 more
Pytest Containerization Pyspark Data Pipelines Atlassian Bamboo Legacy Systems Databricks

Job description

As a Senior Data Engineer, you will help design and build the next-generation Azure data platform while acting as a technical leader within the team., * Design and build Azure-based cloud-native data platforms

  • Develop and maintain CI/CD pipelines
  • Build scalable data pipelines
  • Integrate data from modern and legacy systems
  • APIs
  • Streaming platforms
  • CSV batch integrations
  • Support migration from legacy platforms to Azure
  • Design reliable migration patterns for phased migrations
  • Improve architecture where necessary together with architects
  • Share technical knowledge and raise engineering standards
  • Participate in Agile Scrum ceremonies
  • Participate in business-hours on-call rotation

Requirements

  • Microsoft Azure
  • Python
  • Object-Oriented Programming
  • Pytest
  • SQL and/or PySpark
  • Databricks
  • Git
  • Azure DevOps / Azure Pipelines
  • CI/CD
  • Cloud Native development

About the company

Since 2000 we provide professional solutions to organizations ranging from tech start-ups to global players. From our offices in Amsterdam and London we have built an international and local network of skilled employed professionals and contractors fuelled by our passion for connecting skills with projects. Over the years we have fulfilled over 1700 requirements and nowadays we consistently have 250+ professionals recruited and relocated from 14 countries allocated to various projects. Our strength is the way that we see and treat people. This will always be a key factor in our strategy for many years to come.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on nl.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · WWC 2024

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:05 min

Tagging and organizing execution scenarios with pytest markers

Florian Bruhin · WWC 2021

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all