Lead Data Engineer
Cubiq Recruitment
Charing Cross, United Kingdom
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 130KJob location
Charing Cross, United Kingdom
Tech stack
Artificial Intelligence
Airflow
Azure
Google BigQuery
Cloud Computing
Data Flow Control
Python
Large Language Models
Data Management
Terraform
Apache Beam
Docker
Requirements
-
Has deep, hands-on experience running data platforms on GCP
-
Uses Python day-to-day
-
Has operated BigQuery at scale, and understands how queries behave across hundreds of terabytes
-
Has built production systems with Airflow / Composer, DBT, Terraform and Docker
-
Is comfortable with GKE, Cloud Run or Cloud Functions
-
Has worked with streaming systems built on Dataflow / Apache Beam
-
Has experience working in regulated environments and alongside security teams, ideally with exposure to ISO27001
-
Can work closely with non-technical stakeholders and shape solutions rather than just execute tickets
About the company
I'm working with a scaling Techbio company that's built its entire data platform on GCP and is now hiring a Lead Data Engineer to take real ownership of it.
They handle genuinely sensitive, population-scale health data for pharma and biotech customers, with multi-terabyte datasets landing regularly from third parties and from Azure environments that need to be pulled safely into BigQuery.
They're looking for someone who can come in and make sense of that environment quickly… design ingestion patterns for huge data drops, think carefully about cost and observability, and work closely with internal medical teams to translate real-world questions into production systems.
They're a super smart, humble team and the right person will be given freedom to take real ownership with the opportunity to work on cutting-edge AI, custom build LLMs, infrastructure - whatever suits you best!