Data Engineer

Harnham
London, UK
1 day ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
£35,000.0 - £40,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Data Analysis Microsoft Azure Cloud Computing Information Engineering Extract Transform Load (ETL) Data Migration Data Systems Python (Programming Language) Software Product Management Pandas Pyspark
+6 more
Infrastructure Automation Frameworks Qlikview Cloud Migration Terraform Data Pipelines Databricks

Job description

You’ll join a skilled and collaborative analytics team of eight, working closely with senior leadership. The team has already laid the foundations for a modern data platform using Azure and Databricks and is now focused on building out scalable ETL processes, integrating AI tools, and delivering bespoke analytics solutions across the organisation., As a Data Engineer, you’ll play a pivotal role in designing and implementing robust data pipelines, supporting the migration from legacy Azure systems to Databricks, and working closely with stakeholders to deliver tailored data solutions. This role combines hands-on development with collaborative architecture design, and offers the opportunity to contribute to AI readiness within a fast-paced business., * Develop and maintain ETL pipelines, including manual and semi-manual data loads

  • Connect and integrate diverse data sources across cloud platforms
  • Collaborate with analytics and design teams to create bespoke, scalable data solutions
  • Support data migration efforts from Azure to Databricks
  • Use Terraform to manage and deploy cloud infrastructure
  • Build robust data workflows in Python (e.g., pandas, PySpark)
  • Ensure the platform is scalable, efficient, and ready for future AI use cases

Requirements

  • Strong experience with Azure and Databricks environments
  • Advanced Python skills for data engineering (pandas, PySpark)
  • Proficiency in designing and maintaining ETL pipelines
  • Experience with Terraform for infrastructure automation
  • Track record of working on cloud migration projects, especially Azure to Databricks
  • Comfortable working onsite in London 2 days/week and engaging cross-functionally
  • Strong communication and problem-solving abilities

NICE TO HAVES

  • Experience with Qlik or other data visualisation tools
  • Exposure to AI product integration or readiness projects

About the company

A rapidly growing investment firm headquartered in London, which has doubled its team over the past 2.5 years and continues to attract strong investor backing. With 230+ employees and ongoing expansion, the company is now focused on becoming more AI- and data-enabled, modernising its infrastructure to support more advanced analytics and automation.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:33 min

Refactoring data science workflows using Rapids QDF and Pandas

Paul Graham Paul Graham · LIVE

6:58 min

Analyzing production code coverage data using pandas

Markus Harrer Markus Harrer · World Congress 2021

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all