Data Engineer

Divitel
Apeldoorn, Netherlands
16 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Apeldoorn, Netherlands

Tech stack

Artificial Intelligence
Airflow
Batch Processing
Databases
Data Validation
Information Engineering
ETL
Database Queries
Distributed Computing Environment
Document-Oriented Databases
Elasticsearch
IPTV
Python
Log Analysis
Operational Data Store
Query Optimization
Simple Network Management Protocols
Syslog
Data Processing
Spark
Audio Codec
Data Lake
Apache Flink
Video Streaming
Data Pipelines

Job description

MindRelay turns fragmented operational data from multi-vendor IPTV and broadband platforms into structured intelligence. As a Data Engineer, you will design the pipelines, data models, and lake architecture that make this possible. You will work at the intersection of data engineering and operational technology, building systems that have a direct impact on service quality for millions of subscribers. What you will do - Design and maintain scalable ETL/ELT pipelines that collect and normalise data from diverse vendor systems - Build and evolve the MindRelay sovereign data lake: schema design, partitioning, and query optimisation - Develop data models that support operational dashboards, anomaly detection, and AI-powered analysis - Collaborate with platform and product teams to define data contracts and integration patterns - Implement data quality checks, monitoring, and alerting on pipeline health - Document data lineage and contribute to our internal data catalogue

Requirements

What we are looking for - 3+ years of experience in data engineering or a related role - Strong SQL skills and experience with columnar or time-series databases - Proficiency in Python for data processing and pipeline development - Experience with Apache Spark, Flink, or similar distributed processing frameworks - Familiarity with data lake patterns and modern data stack tooling (dbt, Airflow, or similar) - Solid understanding of streaming vs. batch processing trade-offs Nice to have - Experience with SNMP, syslog, or other network telemetry protocols - Background in telecom, media, or broadcast industries - Knowledge of MPEG-2/4 or video streaming quality metrics - Experience with Elasticsearch or OpenSearch for log analytics What w...

Apply for this position