Data Engineer/Platform Engineer Enterprise Data Lake

We are building a global data platform that will serve as the organization's single source of truth for reporting and analytics. This platform supports a common data model and enables a self-service data science workbench for stakeholders.

As a Data Engineer/Platform Engineer, you will play a key role in shaping, managing, and enhancing the enterprise data lake. You will work hands-on with big data technologies, build robust data ingestion pipelines, and ensure reliable access to high-quality data across the business.

Key Responsibilities

• Prepare and manage datasets and data pipelines for business use.
• Troubleshoot and resolve data-related issues.
• Develop XML-based ingestion pipelines into the Data Platform using Hive/S3.
• Build IBM MQ native schemaless ingestion pipelines.
• Collaborate with business stakeholders to understand data needs and deliver solutions.

• Strong hands-on experience with Big Data technologies, including:

• Hadoop, Hive, Spark, Trino, Airflow/NiFi, MinIO, Kubernetes (K8s), Kafka.

• Expert-level SQL skills, ideally across both classical DWH and distributed environments.
• Knowledge of banking data products and the financial sector.
• Solid understanding of financial data classification and sensitivity.
• Expertise in metadata management and related tools.
• Strong understanding of data modelling standards, processes, and tools (data cleansing, metadata management, etc.).

Soft Skills

• Excellent business stakeholder management.
• Strong Agile project management skills.
• Ability to work effectively under pressure and resolve unforeseen roadblocks.
• Strong interpersonal and communication skills.
• Experience working in cross-divisional, collaborative environments.