Data Engineer
Role details
Job location
Tech stack
Job description
The Data & Insights department ensures that we keep accurate data at the heart of all of Ocado Retail's decision making. As a Data Engineer your skills will be essential in building and maintaining the foundations of our data solution; bringing in large quantities of data from a variety of sources, and ensuring it's clearly structured and documented. The data warehouse you would help manage would then be used by our Reporting team to deliver business intelligence to a wide range of stakeholders, and our Insights and Data Science teams to experiment and improve our proposition.
This Data Engineer role sits within a distributed Data Management team (offshore and onshore) of ~20. You will work through a backlog of developments to evolve our data warehouse. This includes integrating new data sources, developing data marts, analysing and resolving data quality issues and evolving our framework and practices to improve our delivery or development efficiency.
What you'll do
- Work as part of the Data Management team to build and maintain our data warehouse.
- Work with data users around the business to understand new requirements or issues with existing assets.
- Build ELT pipelines, sourcing data from multiple systems and propagating results into data warehouse and marts.
- Monitor, manage and resolve operational and quality issues within the data warehouse and marts.
- Manage security and information confidentiality.
- Peer QA and test deliverables.
- Support deployment and validation.
- Adhere to agreed standards and processes to ensure our work output is consistent, compliant and of high quality.
- Contribute to development of standards and processes to take advantage of rapidly evolving technologies, to improve team efficiency or work quality (e.g. with AI assistance).
- Collaborate with technical teams to integrate data scientists' models and business logic into production systems
Requirements
Do you have experience in SQL?, * Experience with cloud data engineering, preferably with Google Cloud Platform
- Proficient with SQL and Python
- Experience working with cloud data orchestration tools e.g. Google Cloud Composer/Apache Airflow
- Experience working with grocery retail/e-commerce data
- Experience working with change management and CI/CD tools e.g. GitLab
- Evidence of improving efficiency in a data organisation with effective automation
- Experience working with Agile or other responsive application development methods
- Able to self-direct and take on broad projects from end-to-end
- Comfortable interacting with a wide range of stakeholders and data consumers