Data Engineer

Futureproofing

London, UK

about 1 month ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.apply4u.co.uk

Tech stack

Application Programming Interfaces (APIs) Microsoft Azure Databases Continuous Integration Information Engineering Data Infrastructure Data Integrity Extract Transform Load (ETL) Data Warehousing Dimensional Modeling Data Intelligence SQL Azure

+10 more

Data Streaming Scripting Azure Data Factory Delivery Pipeline Data Strategy Data Analytics Data Management Azure Synapse Analytics Data Pipelines Databricks

Job description

incorporating the latest advancements in data intelligence while supporting strategic business objectives. Key Responsibilities Build & Develop - Design and maintain a robust Databricks Data Platform, ensuring performance, scalability, and availability. Data Pipelines - Connect APIs, databases, and data streams to the platform, implementing ETL/ELT processes. Data Integrity - Embed quality measures, monitoring, and alerting mechanisms. CI/CD & Automation - Create deployment pipelines and automate workflows. Collaboration - Work with stakeholders across Global IT, Data, and Broking teams to translate business requirements into technical solutions. Futureproofing - Drive the evolution of the data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure SQL).

Requirements

Data Engineer

Location: London (Hybrid - 2 days WFO)

Salary: £60,000-£80,000

London Market Insurance experience ESSENTIAL. The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you’ll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, Dimensional modelling / DWH Design Medallion Architecture Strong ETL/ELT development skills. Python scripting experience for data automation. Experience with CI/CD methodologies for data platforms. Previous London Market Insurance experience Why Join? Greenfield Project - Work on an all-new data platform, shaping its architecture from the ground up. Collaborative Culture - Engage with global teams in an agile, innovative environment. Career Growth - Play a pivotal role in driving data excellence within a forward-thinking business. Cutting-Edge Tech - Work with the latest advancements in Azure, Databricks, and Data Engineering . This is a fantastic opportunity for a Lead Data Engineer looking to make a tangible impact. If you’re ready to take on a challenging and rewarding role, apply today!