> Markdown version of [/jobs/ext/1942252-data-engineer-kafka-elasticsearch](https://www.wearedevelopers.com/jobs/ext/1942252-data-engineer-kafka-elasticsearch). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Kafka & Elasticsearch - **Company:** Pauwels Consulting - **Location:** Brussel, Belgium - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Continuous Integration, Data Systems, Elasticsearch, Monitoring of Systems, PostgreSQL, OpenShift, Performance Tuning, Service Layer, Unstructured Data, Scripting, Database Optimization, Event Driven Architecture, Gitlab-ci, Kubernetes, Avro, Apache Kafka, Kibana, Restful APIs, Data Pipelines, Docker, Microservices - **Published:** August 6, 2026 - **Apply:** https://www.vdab.be/vindeenjob/vacatures/74313554 ## About the Role * 3+ years of experience with Apache Kafka, including Kafka Streams, Connect, Schema Registry, Avro, and ksqlDB. * 3+ years of experience with Elasticsearch, covering Kibana, ingest pipelines, and index lifecycle management. * You possess strong knowledge of container orchestration using Docker, Kubernetes, and OpenShift. * You have experience developing data service layers through REST APIs and microservices. * You bring proficiency in Python scripting and experience with PostgreSQL databases. * You're familiar with CI/CD tools, specifically GitLab CI, for automating data pipelines. * You have expertise in observability, error handling, and the optimization of complex data systems. * You are methodical and precise, with a strong ability to document technical architectures and configurations. * You are proactive and solution-oriented, thriving in multidisciplinary team environments. * You have active knowledge of Dutch, French, and English. Nice to Haves * Willingness to adapt to flexible schedules within a complex technical environment. ## Description * Design, implement, and manage event-driven architectures using Apache Kafka as a core buffer and processing layer. * Build and maintain Elasticsearch stacks, including indexing strategies and lifecycle management for structured and unstructured data. * Develop a data service layer using REST APIs and microservices to make data available for analysis and monitoring. * Deploy and orchestrate data components within Docker, Kubernetes, and OpenShift environments. * Optimize data pipelines and ensure system observability through GitLab CI and Python scripting. * Ensure data consistency across the entire ecosystem while implementing robust error handling and performance tuning. * Document technical configurations, schemas, and architectural choices to maintain high standards of knowledge transfer. ## Related Videos - [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101) - [Let's Get Started With Apache Kafka® for Python Developers](https://www.wearedevelopers.com/videos/565-let-s-get-started-with-apache-kafka-for-python-developers) - [Debug a Kubernetes Operator](https://www.wearedevelopers.com/videos/487-debug-a-kubernetes-operator) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Add Location-based Searching to Site with ElasticSearch](https://www.wearedevelopers.com/videos/77-add-location-based-searching-to-site-with-elasticsearch) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) ## Related Articles - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Best Companies in the Netherlands: Top 25 Companies in 2023 ](https://www.wearedevelopers.com/magazine/193-best-companies-in-the-netherlands-top-25-companies-in-2023) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Developer Salary in The Netherlands [2023]](https://www.wearedevelopers.com/magazine/217-software-developer-salary-in-the-netherlands-2023)