Lead Data Engineer/Head of Data
Simply Commerce Group Ltd
5 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 115KJob location
Tech stack
Java
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Azure
Google BigQuery
Data as a Services
Data Infrastructure
Data Warehousing
Python
Machine Learning
DataOps
Scala
SQL Databases
Unstructured Data
Google Cloud Platform
Azure
Snowflake
Spark
Luigi
Amazon Web Services (AWS)
Data Management
Data Pipelines
Job description
- Ownership of the company's overall solution architecture
- Ownership of the data infrastructure and data pipelines required to ingest structured and unstructured data for multiple sources to support and drive analytics and reporting
- Deliver the company's data & technology strategy, ensuring close alignment with business objectives and the data and technology roadmap
- Collaborate closely with stakeholders to gather data requirements and translate them into scalable data models
- Design, develop and deliver data capture and reporting systems and technologies from scratch. Develop and own a market-leading and cost-efficient cloud-based data warehouse that aligns with business needs and future scalability.
Requirements
Do you have experience in Technical project management?, + Extensive hands-on experience in data gathering and the building of data warehouses and data products end-to-end
- Strong technical project management skills with a focus on timely delivery and execution from start to finish
- Strong proficiency in SQL, Python, Spark, Java, Scala with the ability to write complex queries, optimise performance and data transformations with preference for experience in AI, machine learning, data-intensive platforms
- Proficiency with cloud data platforms eg AWS, GCP, Azure) and related data services
- Hands-on experience with multiple data warehouse platforms (e.g. Snowflake, BigQuery, AWS Glue, Azure Data Factory, Data bricks, DataOps)
- Proficiency in using CI/CD tools and data orchestration tools (eg. Airflow/ Luigi)
- Proven track record of independently design, develop and delivering cost effective data & technology infrastructure solutions
Benefits & conditions
- Company bonus
- Enhanced Pension
- Wider benefits package TBC
NB This role will be based in London (City) four days per week
James Hodges