Principal Data Engineer
VIQU Ltd
Manchester, United Kingdom
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 100KJob location
Manchester, United Kingdom
Tech stack
Airflow
Google BigQuery
Data Fusion
Python
SQL Databases
Data Streaming
Data Lake
Job description
- Lead the architecture, best practise and engineering strategy of data squads.
- Ensure all data platform processes; including ingestion, quality, transformation, security, batch management, monitoring, alerting, and cost control are efficient.
- Design and help build the Data Mesh - ensuring data is processed through semantic layers and can be modelled effectively.
- Suggest improvements for automation and cost savings.
- Mentor and lead teams of engineers, checking and reviewing code, and setting standards.
Requirements
- Experience as a lead or principal data engineer.
- Prior experience designing data platform(s) within GCP, across Airflow, Big Query, Data Flow, Data Fusion, and Data Stream.
- Deep understanding of Data Mesh design and Data Lake/Warehouse solutions.
- Previously led teams of data engineers.
- Hands on skills across the GCP tech stack, SQL and Python.
- Ability to work across multiple contexts and teams.
