Data Engineer

Médiane Benelux

Luik, Belgium

1 day ago

Apply on www.adzuna.be

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.adzuna.be

Tech stack

Airflow Unit Testing C++ (Programming Language) Databases Continuous Integration Data Architecture Information Engineering Data Warehousing DevOps Python (Programming Language) MATLAB Machine Learning

+12 more

SQL Databases Data Storage Technologies Apache Spark Jupyter Git Data Lakes Kubernetes Information Technology Bitbucket Data Pipelines Docker Jenkins

Job description

Design, build and maintain data pipelines and data architectures Set up and optimize databases, data lakes and data storage solutions Develop data pipelines supporting machine learning and advanced analytics Manage and improve CI/CD pipelines Ensure testing, validation and reliability of data workflows Collaborate with software developers, data scientists and engineering teams Contribute to data engineering standards and continuous improvement initiatives

Requirements

Master’s degree in Computer Science, Engineering, Data Engineering, Data Science or equivalent Solid experience in Data Engineering Strong knowledge of Python, SQL, Spark and Docker Good understanding of databases, data lakes, data warehouses and CI/CD Experience with tools such as Jenkins, Jupyter, Superset and Dagster Knowledge of Kubeflow or data warehousing solutions is a plus Good understanding of unit testing Knowledge of Git, DevOps, C/C++, Bitbucket or MATLAB testing is an advantage Strong analytical mindset, attention to detail and quality-oriented approach Comfortable working in multidisciplinary technical environments