Senior Python Data Engineer (AI & Data Migration) Job ID: JP054841

Senior Python Data Engineer (AI-Assisted Data Migration)

We are looking for a Senior Python Data Engineer to support the migration of legacy SAS-based ETL processes to a modern Python data platform using Parquet, PyArrow, Pandas, Polars, and Apache Spark. You will play a key role in developing AI-assisted migration solutions, optimizing agent-driven workflows, and ensuring high-quality, scalable data transformation processes.

Key Responsibilities

• Design, develop, and validate Python-based ETL and data transformation solutions.
• Review and optimize AI-generated Python code for performance, quality, and maintainability.
• Build and enhance data pipelines using Pandas, Polars, PyArrow, Parquet, and PySpark.
• Improve ETL/ELT processes, data quality, schema management, and performance.
• Contribute to AI-assisted software development and multi-agent orchestration workflows.
• Enhance workflow automation, validation processes, and human-in-the-loop quality assurance.
• Collaborate with architects, data engineers, and SAS experts to support complex migration scenarios.
• Ensure robust testing, documentation, and operational reliability of migration solutions.

Required Skills \& Experience

• 5 years of experience in Python Data Engineering.
• Strong expertise in Python, Pandas, Polars, PyArrow, Parquet, Apache Spark/PySpark, and Python performance tuning.
• Experience with ETL/ELT, data engineering, data quality, schema management, and testing frameworks.
• Experience using AI-assisted development tools (e.g., GitHub Copilot or similar).
• Knowledge of agentic workflows, multi-agent systems, workflow orchestration, and AI-driven automation.
• Familiarity with SAS Base (DATA Step, PROC SQL, Macros, ETL patterns) is a strong advantage.

Languages

• Active knowledge of Dutch , French , and English.

Location

• Brussels, Belgium
• Hybrid working model.

Apache, SQL, Python