Data Engineer 12 month FTC

SmartestEnergy
London, UK
7 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles Computing Platforms Microsoft Azure Code Review Continuous Integration Information Engineering Data Integration Extract Transform Load (ETL) Data Transformation Data Warehousing Apache Hive Python (Programming Language)
+13 more
Scrum Methodology Power BI Standard Sql Software Engineering Transact-SQL Enterprise Data Management Azure Data Factory Apache Spark Microsoft Fabric Pyspark Data Analytics Data Lakehouse Data Pipelines

Job description

Join our growing team as a Data Engineer and play a key role in building modern, cloud-based data solutions that enable better business decision-making. This is an excellent opportunity for someone experience and who is passionate about data, eager to learn, and excited to work with Microsoft’s Azure Data Platform and Microsoft Fabric. You’ll work on developing enterprise-scale data pipelines, supporting Data Lakehouse and Data Warehouse solutions, and working with modern data architectures under the guidance of experienced engineers and architects.

In this role, you’ll contribute to the development, testing, and maintenance of reliable data pipelines, support ETL processes across the Medallion Architecture, and help ensure data quality, governance, and reporting capabilities. You will be familiar with Azure DevOps, CI/CD practices, Spark notebooks, and Power BI and participate in collaborative code reviews, design sessions, and continuous learning opportunities., Once we receive your application, it will be reviewed by a human - no bots here! The average process typically takes around 2-3 weeks, with 2 stages of video interviews using Teams. However, this can vary depending on the role. We may invite you for a face-to-face meeting or require only 1 video interview. If you have any questions or need support, our Recruitment Team is here to assist you.

Requirements

  • Experienced in a Data Engineering, Data Analytics, or Software Development role, with a good understanding of ETL/ELT concepts and data integration principles;
  • Very strong PySpark for developing scalable data pipelines and data transformations and SQL skills (T-SQL and/or Spark SQL) and working knowledge of Python;
  • Hands-on experience with Microsoft Fabric and/or Azure Data Platform technologies, including Data Factory, Synapse, Lakehouse, Data Pipelines, Dataflows Gen2, Notebooks, and Power BI integration;
  • Understanding of modern data engineering practices, including Medallion Architecture (Bronze/Silver/Gold), CI/CD, Azure DevOps, Agile/Scrum methodologies, testing, and clean code principles;
  • Knowledge of enterprise data warehousing, semantic models, data quality, security, and governance, with a willingness to learn and apply emerging Microsoft Fabric capabilities such as Real-Time Intelligence.

Benefits & conditions

Global Impact: With offices in the UK, US, and Australia, and plans for further expansion, you’ll be part of a dynamic, globally-minded team, with opportunities to explore new markets and make a difference on a global scale.

  • Flexible Working: Embrace the freedom to work from anywhere in the world for up to 30 days a year. We prioritize work-life balance, recognizing that your well-being matters. Find out more here.
  • Commitment to Diversity and Inclusion: We celebrate our diverse culture and value individuals irrespective of background, disability, religion, gender identity, sexuality, or ethnicity. Join a team where diversity is not just welcomed but celebrated as a key driver of growth and innovation.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on uk.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:39 min

Addressing code review surrender and process exploitation

Laura Tacho Laura Tacho · WWC Europe 2026

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:46 min

Traditional data architecture before Microsoft Fabric

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · WWC 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:48 min

Standardizing data access schemas with OData

Florian Bader Florian Bader · WWC Europe 2026

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all