> Markdown version of [/jobs/ext/1342008-software-engineer-data-platforms](https://www.wearedevelopers.com/jobs/ext/1342008-software-engineer-data-platforms). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer (Data Platforms) - **Company:** Squid - **Location:** London, UK - **Salary:** £75,000.0 - £200,000.0 - **Contract:** Permanent contract - **Skills:** Geographic Information Systems, Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Batch Processing, Big Data, Cloud Computing, Code Review, Complex Networks, Databases, Directed Acyclic Graph (Directed Graphs), Data Architecture, Data Auditing, Data Centers, Information Engineering, Data Mapping, Data Warehousing, Programming Tools, Python (Programming Language), PostgreSQL, Operational Data Store, Operational Databases, Standard Sql, Scientific Computating, Software Engineering, Squid (Proxy Server), Management of Software Versions, Web Services, Workflow Management Systems, Data Management, Data Pipelines - **Published:** July 19, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=8610fbf38b760bed ## About the Role You do not need to meet every requirement. We are looking for strong data engineers who enjoy making difficult, messy datasets reliable and usable. You may be a strong fit if you have: * Professional experience building and maintaining production data pipelines. * Strong Python and SQL skills, with experience working with Postgres or similar databases. * Experience designing data models, schemas and transformation layers for complex datasets. * Experience with directed acyclic graph-based orchestration tools such as Airflow, Dagster, Prefect or similar systems. * Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. * Experience with data quality testing, lineage, observability, versioning or change-data capture. * The ability to work with incomplete, inconsistent or poorly documented source data. * Strong software engineering fundamentals, including testing, code review and maintainable system design. * An interest in applied AI, data evaluation and building reliable data foundations for AI systems. * High ownership, clear communication and a willingness to work directly with technical customers. Experience with geospatial data, graph data, time-series data, scientific computing, energy data or other complex engineering datasets would be valuable, but is not required. ## Description AI and data centres are booming, electrification is accelerating, and trillions in generation, storage, and connection projects are queued - but the real bottleneck is the grid. Grid planning and operations are becoming a national-scale systems problem: complex network models, messy legacy data, strict governance, overloaded teams, and high-stakes decisions that affect real infrastructure. Squid is building the agentic modelling platform for power grids: a versioned, auditable source of truth where network models, data, changes, assumptions, and decisions can be tracked - and where humans and AI agents can safely work together. We unify legacy planning models, operational data, and grid workflows into software that helps teams run checks, compare models, explain changes, validate assumptions, and move faster without losing engineering rigour. Based in London, Squid is backed by premier investors like Y Combinator and partners with industry leaders including National Grid and Northern Powergrid. About the role Pay Range: £75k-£200k (salary + equity), based in London, UK. We are hiring a Data Engineer to join Squid as one of our first engineers. You will work closely with the founders and early engineering team to build the data foundations of our platform for grid operators. The role combines data engineering, software engineering, infrastructure and applied AI. You will work with large, complex and often inconsistent technical datasets, building reliable systems to ingest, transform, validate, connect and serve them. This is a high-ownership role based in our central London office, with the opportunity to shape our data architecture, engineering practices and product from an early stage. What you'll do * Build production data pipelines for ingesting, transforming, validating and serving complex datasets. * Design scalable data models, schemas and storage systems for structured, semi-structured and geospatial data. * Build pipeline orchestration using directed acyclic graphs, or DAGs, to manage dependencies, retries, scheduling and observability. * Develop systems for data quality testing, lineage, versioning, reconciliation and change detection. * Create tools for combining datasets from different systems while preserving provenance and auditability. * Build APIs and services that make processed data available to products, customers and AI systems. * Develop workflows for batch processing, event-driven processing and long-running computational jobs. * Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. * Work directly with customers and domain experts to understand source systems and data problems. * Use modern AI development tools to accelerate data mapping, validation and pipeline development. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1146-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)