Lead Data Engineer
SWIFT
Brussels, Belgium
7 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Brussels, Belgium
Tech stack
Java
Airflow
Amazon Web Services (AWS)
Confluence
JIRA
Configuration Management
Code Coverage
Collaborative Software
Continuous Integration
Information Engineering
Data Warehousing
Dynamic Program Analysis
Elasticsearch
Github
Python
Shell
Maven
Octopus Deploy
Openshift
Public Key Infrastructure
Systems Development Life Cycle
Software Engineering
Scripting (Bash/Python/Go/Ruby)
Transport Layer Security
Spark
GIT
Containerization
Data Lake
Kubernetes
Kafka
Bitbucket
Data Management
Kibana
Terraform
Data Pipelines
Jenkins
Job description
- Own the end-to-end technical vision for one or more core components of the Data Management Platform, ensuring long-term scalability, resilience, and alignment with enterprise standards.
- Drive design decisions (not just implementation) and actively contribute to design reviews across teams.
- Anticipate future platform needs (capacity, performance, security, governance) and proactively evolve the platform accordingly.
- Define and enforce engineering standards, patterns, and reference architectures for data pipelines, storage, and processing.
- Be accountable for the technical delivery of complex, cross-team initiatives, including planning, risk management, and execution.
- Ensure operational excellence: observability, monitoring, incident prevention, and production stability across the platform.
- Lead root-cause analysis for major incidents and drive systemic improvements, not just fixes.
- Act as a technical lead and coach for multiple engineers, helping them grow in autonomy, design skills, and platform understanding.
- Mentor senior and less senior engineers, setting a high bar for engineering craftsmanship.
- Coordinate and guide the work of multiple contributors or a small group of teams, ensuring consistency and alignment.
- Foster a strong engineering culture: knowledge sharing, documentation, reuse, and continuous improvement.
- Translate complex technical topics into clear, actionable insights for non-technical stakeholders.
- Contribute to roadmap definition, technical feasibility assessments, and prioritization discussions.
Requirements
- 10 to 14 years experience in systems development; with 2 years exposure to the team leader role
- Proven expertise in data engineering and software development practices.
- Hands-on experience on a Data Management Platform., Must Have:
- Advanced hands-on expertise with Java 11 and Java 17.
- Strong scripting skills (Unix Shell or Python).
- Solid understanding of containerization technologies (OpenShift or Kubernetes).
- Proven experience with Helm for configuration management and containerized deployments.
- Experience with large-scale object storage such as Amazon S3 or equivalent solutions.
- Proven experience with at least one of the data management tools such as Spark or Kafka
- Understanding of Data Engineering, Data lake, Data Warehousing and Medallion architecture concept.
- Hands-on experience in CI/CD environments (Git, Jenkins, Maven) and tools for code coverage and static/dynamic analysis.
- Experience with PKI/SSL for secure communications and certificate-based authentication.
- Practical experience with Agile/Scrum methodologies and collaboration tools (JIRA, Confluence, Bitbucket, GitHub).
Good to have
- Experience with Apache Airflow as a job orchestration and workflow management tool
- Experience with Elasticsearch/Kibana.
- Experience with Infrastructure as code as such Argo CD, Terraform is a plus
Competency profile
- Strong written and verbal communication skills.
- Ability to lead, coach, and support junior team members.
- Passion for continuous improvement and innovation.
- Team-oriented mindset and comfort working in a multicultural environment.
- Quick learner with a strong appetite for new technologies.
- Strong interpersonal skills and customer-centric approach.
- Ability to thrive in a fast-paced, deadline-driven environment.
About the company
We're the world's leading provider of secure financial messaging services, headquartered in Belgium. We are the way the world moves value - across borders, through cities and overseas. No other organisation can address the scale, precision, pace and trust that this demands, and we're proud to support the global economy.
We're unique too. We were established to find a better way for the global financial community to move value - a reliable, safe and secure approach that the community can trust, completely. We're always striving to be better and are constantly evolving in an ever-changing landscape, without undermining that trust. Five decades on, our vibrant community reflects the complexity and diversity of the financial ecosystem. We innovate diligently, test exhaustively, then implement fast. In a connected and exciting era, our mission has never been more relevant. Swift now has a presence in 200+ countries and legal territories to serve a community of more than 12,000 banks and financial institutions.