Data Platform Engineer

• Define, build, and evolve the enterprise Data Lakehouse platform
• Collaborate with Platform Engineering and Application Engineering teams
• Manage the infrastructure, patterns, standards, and tooling for data products
• Ensure the data platform is secure, reliable, and cost-effective
• Operate, maintain, monitor, and extend the platform within AWS
• Focus on early fault detection and fault prevention in AWS data services
• Design and maintain Infrastructure as Code and Configuration as Code solutions
• Implement CI/CD pipelines for consistent and repeatable deployments
• Enhance data lake integration testing and security measures
• Monitor SLAs and operational metrics for continual improvement

Technologies:

• AWS
• AWS Glue
• Redshift
• Ansible
• CI/CD
• Databricks
• GitLab
• Jenkins
• Kafka
• Python
• Security
• Snowflake
• Spark
• Terraform
• Cloud

• Proficiency in AWS services (AWS Glue, S3, RDS, Redshift, etc.)
• Experience with Apache Spark, Kafka/MSK, and Iceberg
• Strong skills in Python and Terraform
• Knowledge of Ansible, CI/CD, Jenkins, and GitLab
• Familiarity with Snowflake and Databricks
• Solid understanding of infrastructure management and observability principles
• Background in data platform engineering or related field
• Strong problem-solving skills and ability to work collaboratively in a team environment
• Commitment to engineering best practices and continuous improvement

We are an established FinTech client located in London, dedicated to growing our enterprise Data Lakehouse platform during an exciting period of expansion. We value a collaborative environment and engineering best practices within our tech-driven organization. This role offers a hybrid working arrangement, with the expectation to be in the office a few times per month.