Data Platform Engineer

Oliver Bernard are working with an innovative client in the cloud security space who are building an AI-first platform that helps organisations identify, understand, and reduce real security risk across their cloud environments. They're expanding their engineering function and are now looking for an experienced Senior Data Engineer to join the team.

About the Role

This position sits at the core of their data platform. You'll be responsible for designing and scaling systems that handle large, complex datasets, enabling their AI agents to deliver accurate and actionable insights.

You'll work closely with product, ML, and backend teams, and will have genuine ownership over data architecture decisions as the platform continues to grow.

Tech Stack

• Python
• Apache Iceberg & modern lakehouse tooling
• Databricks
• Kafka
• Spark
• BigQuery or Redshift

What You'll Be Doing

• Building and evolving distributed data pipelines that support both batch and streaming workloads
• Developing robust data models that enable efficient analysis and vulnerability detection
• Enhancing the reliability and performance of the platform's data services
• Playing a key role in shaping best practices and long-term data strategy

• 7+ years' experience as a Software Engineer
• 4+ years in Data Engineering with exposure to large-scale datasets
• Strong understanding of distributed systems and event-driven architectures
• Experience with cloud data warehouses (BigQuery or Redshift)