Data Engineer - Kafka & Elasticsearch Job ID: JP054994

We are looking for an experienced Data Engineer specialized in event-driven architectures and real-time data integration, with strong expertise in Apache Kafka and Elasticsearch., * Design, implement and manage Kafka and Elasticsearch data pipelines.

• Configure Kafka topics, Schema Registry, Avro, Kafka Streams, Connect and ksqlDB.
• Develop Elasticsearch indexing strategies, ingest pipelines and lifecycle management.
• Build REST APIs and microservices to expose data through a data service layer.
• Ensure data consistency, scalability, observability and reliable error handling.
• Deploy and manage components using Docker, Kubernetes and OpenShift.
• Implement CI/CD pipelines with GitLab CI and use Python for scripting and optimization.
• Document pipelines, schemas, configurations and technical solutions.

• Apache Kafka and Schema Management
• Elasticsearch and Kibana
• REST APIs and Microservices
• Docker, Kubernetes and OpenShift
• GitLab CI/CD
• Python and PostgreSQL
• Data pipeline observability, troubleshooting and optimization
• Dutch, English and French knowledge