Data Engineer

Data Engineer / London / Hybrid / Energy TradingA growing B2B energy supplier operating at the forefront of the UK energy market is investing heavily in its data platform and engineering capability as the business continues to scale its trading operations.They are looking for a Data Engineer with strong Apache Airflow experience to help design and build the pipelines that power trading, analytics and commercial decision-making.This is a great opportunity to join a small, highly experienced team where engineers have real ownership of the data platform and the opportunity to work with modern open-source technologies.What You'll Be DoingDesigning and building data pipelines orchestrated with Apache AirflowDeveloping ETL/ELT workflows in Python and SQL to process trading and operational dataBuilding reliable, scalable data infrastructure to support analytics and business insightCollaborating with analysts, product teams and trading teams to deliver high-value datasetsImproving data quality, monitoring and pipeline reliabilityHelping shape the future architecture of the data platformTech Stack - You don't need everything here, but experience with some of the following is expected:Apache Airflow (core focus)PythonSQLApache Spark or KafkaPostgreSQL or similar relational databasesDocker or containerised environmentsGit and CI/CD workflowsData modelling and data warehousing conceptsWhat They're Looking ForExperience building and maintaining data pipelines in productionStrong Python and SQL skillsHands-on experience with Apache AirflowSomeone who enjoys solving data engineering and infrastructure challengesA collaborative engineer comfortable working with both technical and business stakeholdersWhy This RoleWork in a data-driven trading environmentJoin a small team where you can influence architectureBuild modern data infrastructure from the ground upExposure to energy trading data and real-time market informationExperience: Typically 2-5 years in Data Engineering or similar roles. Similar jobs, A leading tech consultancy is seeking a Data Engineer to support a university's major data platform transformation project using AWS. The successful candidate will have strong hands-on experience with AWS Glue and PySpark, responsible for developing scalable data workflows..., Delivery Manager - Data Engineering ?? Manchester (Hybrid) We're working with a leading global investment firm looking to hire a Delivery Manager - Data Engineering to lead a team of Data, DataOps and MLOps engineers. This is a great opportunity to take ownership of..., Job Description Your new companyWorking for a renowned financial services organisationYour new roleSeeking a Data Engineer to help design and maintain scalable batch and near-real-time ingestion pipelines, modernizing legacy ETL/ELT processes into Azure and Snowflake, and...

A leading IT consulting firm is seeking a skilled Data Engineer specializing in Snowflake for a remote opportunity. The ideal candidate will have over 7 years of experience in data engineering, with strong skills in building ETL/ELT pipelines, data modeling, and performance..., A private equity investor in London seeks a Data Engineer to enhance its data platform. You'll own key components, develop ETL pipelines, and lead data migration. Applicants should have 4-6 years of data engineering experience and proficiency in Python and SQL, ideally with...

Job Description Senior Data Engineer £65,000 - £75,000 Manchester or Leeds (Hybrid) This is an opportunity to join a growing, modern banking organisation that is investing heavily in its data platform as it scales. You will have a real impact on how data is engineered,...

Azure Data Engineer

Opus Recruitment Solutions £400 - £450 per day

Azure Data Engineer | Outside IR35 | £400 - £450 | 6 months | Hybrid Liverpool You'll be designing, developing, and managing data pipelines across Azure, primarily using Azure Data Factory to integrate multiple data sources and deliver streamlined workflows into Azure SQL....

AWS Data Engineer (Hybrid) Bristol - Spark, S3, Redshift

Avanti Recruitment £50,000 - £75,000

A major insurance company in Central London is seeking a Data Warehouse Engineer to design and optimize data warehouse solutions. The ideal candidate will have experience with SQL, ETL/ELT tools, and knowledge of the Azure cloud data stack. Responsibilities include..., A global professional services company is seeking a Cloud Data Engineer to support data management and ETL processes for critical client projects. This role requires expertise in Python, PySpark, and experience with AWS or GCP. The company offers a competitive salary and..., A leading data solutions company in the United Kingdom is seeking a Data Architect skilled in designing scalable data solutions using the Snowflake platform. This role involves developing ETL/ELT pipelines, collaborating with teams to meet data requirements, and..., AWS Data Engineer (Hybrid) Bristol - Spark, S3, Redshift, Lambda, EMR, Glue Avanti Recruitment is working with a rapidly growing technology business in Bristol to recruit a talented AWS Data Engineer to join their team. You will help build and evolve their AWS cloud-based...