Data Engineer

Hays plc
Cardiff, UK
14 days ago
Apply on www.apply4u.co.uk
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
£55,000.0
Working hours
Regular working hours

Tech stack

Architectural Patterns Microsoft Azure Data Security Python (Programming Language) Power BI SQL Databases Azure Data Factory Pyspark Core Data Performance Monitor Azure Synapse Analytics Data Pipelines
+1 more
Databricks

Job description

ResponsibilitiesDevelop and maintain data pipelines using Azure Databricks (Python, PySpark and SQL)Implement ingestion and transformation across Bronze, Silver and Gold layers using Delta LakeSupport and operate Azure Databricks and Azure Synapse platforms, including performance monitoring and configurationBuild Gold-layer datasets optimised for Power BI and analytics consumptionSupport production workloads, resolve incidents and maintain operational documentationApply security, governance and access control standards suitable for a regulated environmentContribute to engineering standards, CI/CD pipelines and code reviewsWhat you’ll need to succeedEssentialProven experience as a Data EngineerStrong hands-on experience with AzureDatabricks, Python, PySpark and SQLExperience supporting Azure data platforms in productionUnderstanding of medallion architecture and Delta LakeDesirableExperience with Azure Synapse AnalyticsExperience with Azure Data FactoryExperience in financial services or

Requirements

hands-on and implementation-focused, working within established architectural patterns to deliver reliable, secure and well-governed data for analytics, Power BI reporting and regulated finance use cases. The role also includes responsibility for supporting and maintaining underlying data platform services, including Azure Databricks and Azure Synapse.Key AccountabilitiesDelivery of reliable, scalable and well-governed data pipelines that meet business and regulatory requirementsOperational stability and performance of core data platform services including Azure Databricks and Azure SynapseAvailability of trusted, high-quality Gold-layer datasets for analytics and Power BI reportingAdherence to data security, access control and governance standards within a regulated environmentEffective resolution of data pipeline and platform incidents with clear root-cause understandingMaintenance of accurate documentation, lineage and operational run books to support ongoing platform supportKey

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.apply4u.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

4:21 min

Challenges of traditional mobile data synchronization

Timothy Marland · World Congress 2023

1:46 min

Traditional data architecture before Microsoft Fabric

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · World Congress 2025

3:48 min

Standardizing data access schemas with OData

Florian Bader Florian Bader · World Congress 2026 Europe

Videos

See all

Related articles

See all