Lead Data Engineer
VIQU Ltd
Burnley, United Kingdom
3 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 95KJob location
Remote
Burnley, United Kingdom
Tech stack
Airflow
Google BigQuery
Cloud Computing
Information Engineering
Data Fusion
Python
SQL Databases
Data Streaming
Data Lake
Job description
- Lead the architecture, best practice and engineering strategy of data squads.
- Hands on data engineering work, utilising both python and SQL.
- Mentor and lead teams of engineers, checking and reviewing code, and setting standards.
- Ensure all data platform processes; including ingestion, quality, transformation, security, batch management, monitoring, alerting, and cost control are efficient.
- Design and help build the data platform - ensuring data is processed through semantic layers and can be modelled effectively.
- Lead changes across the organisation, adopting a decentralised design.
Technologies:
- Airflow
- Cloud
- Flow
- GCP
- Python
- SQL
- Security
Requirements
- Experience line managing teams of data professionals.
- Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream.
- Deep understanding of Data Mesh/ decentralized design and Data Lake/Warehouse solutions.
- Hands on skills across the GCP tech stack, SQL and Python.
- Ability to lead cultural change across organisations, and manage senior stakeholders.
- Ability to work across multiple contexts and teams.
About the company
We at VIQU are excited to partner with a national organization that is undergoing a significant transformation in its data infrastructure. We are hiring a Lead Data Engineer who will be crucial in designing the data platform within the Google Cloud Platform (GCP). This role will involve a balance of technical engineering, architecture, and leadership. This position offers a competitive salary range of £85,000 - £95,000 per annum and is based in Manchester with remote flexibility, requiring once-a-month onsite attendance.