Senior Python Data Engineer (AI & Data Migration) Job ID: JP054841

Itproposal
Aalter, Belgium
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
Dutch, English, French
Experience level
Senior

Job location

Aalter, Belgium

Tech stack

Artificial Intelligence
Apache HTTP Server
Information Engineering
ETL
Data Transformation
Data Migration
Data Transformation Services
Python
Performance Tuning
SAS (Software)
SAS/Base
Software Engineering
SQL Databases
Workflow Management Systems
Working Model 2D
Parquet
Macros
GitHub Copilot
Multi-Agent Systems
Spark
Pandas
PySpark
Data Pipelines

Job description

Senior Python Data Engineer (AI-Assisted Data Migration)

We are looking for a Senior Python Data Engineer to support the migration of legacy SAS-based ETL processes to a modern Python data platform using Parquet, PyArrow, Pandas, Polars, and Apache Spark. You will play a key role in developing AI-assisted migration solutions, optimizing agent-driven workflows, and ensuring high-quality, scalable data transformation processes.

Key Responsibilities

  • Design, develop, and validate Python-based ETL and data transformation solutions.
  • Review and optimize AI-generated Python code for performance, quality, and maintainability.
  • Build and enhance data pipelines using Pandas, Polars, PyArrow, Parquet, and PySpark.
  • Improve ETL/ELT processes, data quality, schema management, and performance.
  • Contribute to AI-assisted software development and multi-agent orchestration workflows.
  • Enhance workflow automation, validation processes, and human-in-the-loop quality assurance.
  • Collaborate with architects, data engineers, and SAS experts to support complex migration scenarios.
  • Ensure robust testing, documentation, and operational reliability of migration solutions.

Required Skills & Experience

  • 5 years of experience in Python Data Engineering.
  • Strong expertise in Python, Pandas, Polars, PyArrow, Parquet, Apache Spark/PySpark, and Python performance tuning.
  • Experience with ETL/ELT, data engineering, data quality, schema management, and testing frameworks.
  • Experience using AI-assisted development tools (e.g., GitHub Copilot or similar).
  • Knowledge of agentic workflows, multi-agent systems, workflow orchestration, and AI-driven automation.
  • Familiarity with SAS Base (DATA Step, PROC SQL, Macros, ETL patterns) is a strong advantage.

Languages

  • Active knowledge of Dutch , French , and English.

Location

  • Brussels, Belgium
  • Hybrid working model.

Requirements

Apache, SQL, Python

Apply for this position