Senior Data Engineer
SWIFT
Brussels, Belgium
7 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Brussels, Belgium
Tech stack
Java
Airflow
Amazon Web Services (AWS)
Confluence
JIRA
Configuration Management
Code Coverage
Collaborative Software
Continuous Integration
Information Engineering
Data Governance
Data Warehousing
Dynamic Program Analysis
Elasticsearch
Github
Python
Shell
Maven
Octopus Deploy
Openshift
Public Key Infrastructure
Software Engineering
Scripting (Bash/Python/Go/Ruby)
Transport Layer Security
Spark
GIT
Containerization
Data Lake
Kubernetes
Kafka
Bitbucket
Data Management
Kibana
Software Coding
Terraform
Jenkins
Job description
The candidate will join the Data Management Platform foundation team and will collaborate to deliver a secure, scalable and reliable Data Management Platform (DMP), providing the foundational services and shared libraries that enable product squads across the organization to focus on delivering meaningful business value.
- Design, develop, test, deploy components and common libraries for the Data Management Platform.
- Ensure the platform is stable, monitored, secure and up to date with a recent version of the COTS.
- Design and support pipeline monitoring and troubleshooting to maintain operational stability.
- Follow established data governance, security, and coding standards to ensure compliance and maintainability.
- Define and apply best practices for quality, performance, and scalability to ensure accuracy, consistency, and reliability of the platform.
- Evaluate and recommend technical feasibility and estimates of the proposed systems solutions.
- Contribute to documentation and continuous improvement efforts, including process refinement and knowledge sharing.
- Provide technical assistance to other colleagues and assist in resolving problems reported by less senior team members
- Coordinate and monitor the activities of a small project team.
Requirements
- Minimum of 8 years of relevant software development experience in an international setting.
- Proven expertise in data engineering and software development practices.
- Hands-on experience on a Data Management Platform., Must Have:
- Advanced hands-on expertise with Java 11 and Java 17.
- Strong scripting skills (Unix Shell or Python).
- Solid understanding of containerization technologies (OpenShift or Kubernetes).
- Experience with Helm for configuration management and containerized deployments.
- Experience with large-scale object storage such as Amazon S3 or equivalent solutions.
- Proven experience with at least one of the data management tools such as Spark or Kafka
- Understanding of Data Engineering, Data lake, Data Warehousing and Medallion architecture concept.
- Hands-on experience in CI/CD environments (Git, Jenkins, Maven) and tools for code coverage and static/dynamic analysis.
- Practical experience with Agile/Scrum methodologies and collaboration tools (JIRA, Confluence, Bitbucket, GitHub).
Good to have
- Experience with Apache Airflow as a job orchestration and workflow management tool
- Experience with Elasticsearch/Kibana.
- Experience with Infrastructure as code as such Argo CD, Terraform is a plus
- Experience with PKI/SSL for secure communications and certificate-based authentication.
Competency profile
- Strong written and verbal communication skills.
- Ability to lead, coach, and support junior team members.
- Passion for continuous improvement and innovation.
- Team-oriented mindset and comfort working in a multicultural environment.
- Quick learner with a strong appetite for new technologies.
- Ability to translate business needs into technical solutions.
- Strong interpersonal skills and customer-centric approach.
- Ability to thrive in a fast-paced, deadline-driven environment.
About the company
We're the world's leading provider of secure financial messaging services, headquartered in Belgium. We are the way the world moves value - across borders, through cities and overseas. No other organisation can address the scale, precision, pace and trust that this demands, and we're proud to support the global economy.
We're unique too. We were established to find a better way for the global financial community to move value - a reliable, safe and secure approach that the community can trust, completely. We're always striving to be better and are constantly evolving in an ever-changing landscape, without undermining that trust. Five decades on, our vibrant community reflects the complexity and diversity of the financial ecosystem. We innovate diligently, test exhaustively, then implement fast. In a connected and exciting era, our mission has never been more relevant. Swift now has a presence in 200+ countries and legal territories to serve a community of more than 12,000 banks and financial institutions.