Data Platform Engineer
European Tech Recruit
Brussels Metropolitan Area, Belgium
4 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.adzuna.be
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Audit Trail
Data Deduplication
Information Engineering
Data Infrastructure
Data Retention
Relational Databases
Python (Programming Language)
Machine Learning
Remote File Sharing
ISO/IEC 15504
Management of Software Versions
+3 more
CodeBeamer
Api Design
Data Pipelines
Job description
We’re looking for a Data Platform Engineer to own the end-to-end platform managing a large and growing collection of video data used for Machine Learning.
You’ll replace ad-hoc file sharing and manual processes with a governed, automated and reproducible data platform covering ingestion, storage, metadata, dataset versioning, GDPR/consent management, processing pipelines and reporting.
What You’ll Do
- Build automated video ingestion and processing pipelines, including validation, metadata extraction and deduplication
- Design robust relational data models and metadata catalogues
- Implement GDPR and consent management, audit trails, retention and automated notifications
- Establish dataset versioning and reproducibility across ML experiments
- Build APIs and interfaces for data input, browsing and management
- Develop dashboards covering data quality, dataset usage, compliance and operational metrics
- Ensure traceability aligns with ASPICE and integrate with Codebeamer
- Deploy and operate the platform securely, including appropriate isolation of sensitive data
- Occasionally support data collection and in-car testing
Requirements
- Strong Data Engineering and data pipeline experience
- Excellent relational database design and modelling skills
- Strong Python for automation, pipelines and API development
- Experience handling large media/binary datasets and object storage
- Experience building data dashboards and reporting
- Practical understanding of GDPR, PII, consent and data retention
- Understanding of ML dataset lifecycles and visual-data workflows
- Excellent communication and collaboration skills
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.be
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
LM
Luis Minvielle
over 2 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago
LM
Luis Minvielle
The 12 Best Jobs for Software Engineers
over 2 years ago
EM
Eli McGarvie
Data Engineer Salary UK
over 3 years ago
EM
Eli McGarvie
7 Most Popular Web Developer Jobs in Europe
over 3 years ago
LM
Luis Minvielle
Fully Remote Software Engineer Jobs
over 2 years ago