> Markdown version of [/jobs/ext/2688163-data-engineer](https://www.wearedevelopers.com/jobs/ext/2688163-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Octopus Energy Ltd
- **Location:** London, UK (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Databases, Continuous Delivery, Data as a Services, Information Engineering, Data Visualization, Data Warehousing, Relational Databases, Django Web Framework, Monitoring of Systems, Job Scheduling, Python (Programming Language), PostgreSQL, Prometheus, DataOps, SQL Databases, Parquet, Datadog, Circleci, Data Processing, Grafana, Apache Spark, Backend, Fastapi, Data Lakes, Kubernetes, AWS Data Analytics, Streamlit Framework, Terraform, Docker, Databricks, Programming Languages
- **Published:** September 3, 2026
- **Apply:** https://jobs.lever.co/octoenergy/e0274bd2-929e-4ab5-b082-ab55078f6ec8/apply

## About the Role

* Strong aptitude with SQL, Python and AWS data stack essential;
 * Experience building efficient, scalable databases and APIs (e.g. Django, FastAPI) a huge plus;
 * Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps a huge plus;
 * Experience with Airflow a huge plus;
 * Experience with dbt for pipeline modelling also beneficial;
 * Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them;
 * Able to quickly understand new domain areas and visualise data effectively;
 * Team player excited at the idea of ownership across lots of different projects and tools;
 * Drives knowledge sharing and documentation for a more effective platform;
 * Desirable: energy domain knowledge

## Description

* Acting as the flexibility team's first full-time data engineer, establish the team's data capability, lead the team's data engineering technical direction and represent the team to the cross-team data community
 * Upskill data-literate backend engineers, act as the team's data expert and as a multiplier on other engineers' impact
 * Establish greenfield data engineering systems in a newly established AWS environment
 * Provide a foundational layer of high quality data processing and warehousing that will enable future projects for both our team and others
 * Maintain and develop critical data applications - scoping and implementing architectural improvements for long-term global scalability, robustness and operational efficiency
 * Interface with the established data warehouse, built on Databricks
 * Take ownership of data platform improvements that enhance the capabilities for all teams and drive trust in the stability of the system, * Python as our main programming language
 * Databricks Spark for data processing
 * Databricks/dbt/SQL for data modelling and analytics
 * Streamlit for data applications and visualisations
 * Airflow for job scheduling and tracking
 * CircleCI for continuous deployment
 * Parquet and Delta file formats on S3 for data lake storage
 * Terraform for our infrastructure definition
 * Kubernetes for data services and task orchestration
 * Datadog/Grafana/Prometheus for platform monitoring
 * Django for custom databases and frameworks
 * Postgres / Aurora for our relational databases
 * Notion for documentation

We have a preference for candidates who can work hybrid from our London office, but we're open to fully remote candidates (you do need to be based in the UK).


## Related Videos

- [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)
- [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)