> Markdown version of [/jobs/ext/2452280-data-engineer](https://www.wearedevelopers.com/jobs/ext/2452280-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Octopus Energy Ltd - **Location:** London, UK - **Contract:** Permanent contract - **Skills:** Adobe InDesign, Application Programming Interfaces (APIs), Artificial Intelligence, User Authentication, Spreadsheets, Extract Transform Load (ETL), Data Systems, Relational Databases, Python (Programming Language), PostgreSQL, Octopus Deploy, Standard Sql, Software Engineering, Cloud Platform System, Rate Limiting, Fastapi, Data Analytics, Data Management, Restful APIs, Streamlit Framework, Software Version Control, Data Pipelines, Legacy Systems, Databricks - **Published:** August 27, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=b6891d04f3b9bed3 ## About the Role * Full-stack development experience - particularly with Streamlit, FastAPI, or HTMX. * Experience building and managing REST APIs, including authentication, rate limiting, and documentation. * Familiarity with renewable energy, infrastructure investment, or financial services data. * Experience evaluating and adopting AI/ML tooling to augment engineering workflows. ## Description Help us make a big green dent in the universe. We're on a mission to drive the global renewable energy revolution, and we need many more people to help us make our vision a reality. Octopus Energy Generation (OEGEN) is a leader in sourcing, investing in, and managing a wide range of utility-scale renewable energy assets. As we continue to expand our investment base, we are dedicated to building a diverse team that reflects the communities we serve. Currently, we manage a global portfolio of over £8 billion in renewable energy assets. We are committed to delivering best-in-class responsible investment activity, offering like-minded investors the means and products to invest their capital sustainably. It is our ambition to change the entire energy lifecycle and make every green electron matter, delivering the best outcomes for customers, investors, the environment and society, accelerating the transition to net zero. OEGEN Data, Tech & Transformation Team We are embarking on a comprehensive transformation program designed to drive significant advancements in our business operations and technology landscape. Our primary goal is to transition from our current reliance on legacy systems and specialized off-the-shelf tools to a more integrated, AI-driven, and data-centric operational model. Leveraging insights and guidance from our other technically mature entities like Kraken and OE, we plan to adopt cutting-edge tools and capabilities, particularly in AI and Python-driven solutions. By investing in a diverse range of skills, we aim to create a hybrid team capable of operating in both our legacy and future environments, ultimately transforming OEGEN into an efficient, data-driven organization., We're looking for a Data Engineer who can own the journey of data from source systems to decision-ready outputs. You'll build and maintain pipelines, model data, stand up dashboards, and integrate systems via APIs. In a team this size, you'll also get involved in application development - building internal tools with Streamlit, FastAPI, or HTMX that put data directly in the hands of our investment and asset management teams. In your first 3 months you'll have taken ownership of at least one critical pipeline from an external system into Databricks, and built or materially improved a reporting layer used by Fund Management or Asset Management., * Design, build, and maintain scalable data pipelines in Databricks, ensuring data is reliable, timely, and well-documented. * Own and evolve our Databricks models - define schemas, enforce testing, and keep the warehouse clean. * Automate manual data processes using Python, replacing spreadsheets and ad-hoc workflows with robust, repeatable jobs. * Build performance dashboards and reports in Streamlit and HTMX (FastAPI) that Finance, Asset Management, and Fund Management actually use. * Integrate internal and third-party systems via REST APIs, improving data accessibility across the business. * Champion data quality - implement validation, monitoring, and governance practices that give stakeholders confidence in the numbers. * Collaborate directly with non-technical teams to understand their problems and translate them into data solutions., * Strong SQL and Python skills, used daily for pipeline development, data modelling, and automation. * Experience with modern data stack tooling: a cloud data platform (Databricks preferred), and version control (Git/GitHub). * A solid understanding of data modelling, warehousing patterns, and ETL/ELT design. * To be comfortable working with Postgres or similar relational databases. * Clear communication - you can explain a data model to a fund manager and discuss trade-offs with an engineer. * A bias toward shipping: you'd rather get something working and iterate than spend weeks in design. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi) - [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix) - [Dev Digest 139 - Soft and hard queries](https://www.wearedevelopers.com/magazine/487-dev-digest-139-soft-and-hard-queries)