Data Pipeline Engineer

Wlg
AMSTERDAM, Netherlands
8 days ago
Apply on www.careerjet.nl
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Data Analysis Microsoft Azure Configuration Management Extract Transform Load (ETL) Data Sharing Data Warehousing Failover Graph Database Linux Commands NoSQL Operational Databases SQL Server Integration Services
+8 more
Talend Management of Software Versions Backup and Restore Data Logging C4ISR Informatica Powercenter Apache Nifi Data Pipelines

Job description

WLG and our selected partners use cookies and similar technologies (together “cookies”) that are necessary to present this website, and to ensure you get the best experience of it. If you consent to it, we will also use cookies for analytics and marketing purposes. See our to read more about the cookies we set. You can withdraw and manage your consent at any time, by clicking “Manage cookies” at the bottom of each website page. common–cookies–alert#acceptAll”>Accept all cookies common–cookies–alert#disableAll”>Decline all non-necessary cookies common–cookies–alert#openPreferences”>Cookie preferences common–cookies–preferences#open” class=”company-links bg-company-primary text-company-primary shadow-form inset-x-16 mb-16 rounded max-w-(–breakpoint-sm) p-16 overflow-auto max-h-[80vh] z-cookie-alert backdrop:bg-[rgba(0,0,0,0.6)] sm:p-40 sm:mb-auto fixed top-8”> Select which cookies you accept On this site, we always set cookies that are strictly necessary, meaning they are necessary for the site to function properly. If you consent to it, we will also set other types of cookies. You can provide or withdraw your consent to the different types of cookies using the toggles below. You can change or withdraw your consent at any time, by clicking the link “Manage Cookies”, which is always available at the bottom of the site. To learn more about what the different types of cookies do, how your data is used when they are set etc, see our . Strictly necessary These cookies are necessary to make the site work properly, and are always set when you visit the site. Vendors Teamtailor common–cookies–preferences#handleCategoryToggle”> Analytics These cookies collect information to help us understand how the site is being used. Vendors Teamtailor common–cookies–preferences#handleCategoryToggle”> Marketing These cookies are used to make advertising messages more relevant to you. In some cases, they also deliver additional functions on the site. Vendors Youtube common–cookies–preferences#handleAccept”>Accept these cookies common–cookies–preferences#handleDecline”>Decline all non-necessary cookies common–header–menu#toggle” data-common–header–menu-target=”button” > Career menu Employee Candidate Homepage common–dropdown#toggle”> Share page common–share#handleClick” data-provider=”Facebook”> Facebook common–share#handleClick” data-provider=”Twitter”> X common–share#handleClick” data-provider=”LinkedIn”> LinkedIn ETL/DWH · The Hague Data Pipeline Engineer (NiFi, Talend, NoSQL and Graph Databases) for NATO with security clearance Build the ETL pipelines that bring surveillance and reconnaissance data together - a one-person, deliverable-based engagement in The Hague. careersite–jobs–form-overlay#showFormOverlay” data-careersite–jobs–form-overlay-target=”coverButton”> Apply for this job blocks–cover–scroll#handleScrollDown” title=”Scroll to content”> The data exists. Your job is to get it where it needs to be, reliably. A multinational defence organisation in The Hague needs a data engineer to design and build the ETL processes that bring imagery and reports from sources on different networks into its systems, and then make those flows controllable, observable and resilient. The engagement is one person, delivered as a set of milestones over the year. What you would be doing

  • Documenting, configuring and testing the ETL requirements: source-to-target mapping, traceability and data reconciliation
  • Building data models, pipelines and schemas for data coming from many different sources
  • Putting configuration control in place: baselines, versioning, change approval and rollback
  • Setting up monitoring with metrics, alerts, dashboards and logging
  • Designing and testing resilience: backup and restore, failover, recovery time and point objectives
  • Troubleshooting production data flows, and handing over through a training package and on-the-job training for the administrators

Requirements

  • Hands-on experience with modern ETL tools such as Apache NiFi, Informatica, Talend or SSIS, ideally on AWS or Azure
  • Data modelling and transformation from heterogeneous sources
  • Experience with data sharing platforms, object stores and relational, NoSQL, graph and vector databases
  • Comfort on the Linux command line and a knack for fixing data anomalies
  • Experience delivering against fixed, deliverable-based contracts in multinational teams
  • Familiarity with NATO intelligence and surveillance architecture and applications, and fluent business English

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.nl
Prepare application

Good distractions

Loading talks and stories from around this role…