Data Engineer

MBN Solutions
United Kingdom
1 day ago
Apply on www.apply4u.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Microsoft Excel Application Programming Interfaces (APIs) Automation of Tests Microsoft Azure Continuous Integration Data Sharing Relational Databases Github Python (Programming Language) SQL Azure SQL Databases Data Ingestion
+10 more
Azure Data Factory Git Pandas Pytest Data Lakes Pyspark Restful APIs Terraform Key Vault Databricks

Job description

I’m recruiting a hands-on Data Engineer to build Azure data platforms and integrations for clients globally. You’ll turn messy data from APIs, Excel files and PDFs into reliable datasets that power dashboards, client portals and data-sharing products.

What you’ll do Build Python and PySpark ingestion pipelines with record-level lineage, automated tests and reconciliation checks. Model data in a Databricks medallion lakehouse and design loads that can be safely rerun. Deploy and extend Azure environments in client tenancies using Terraform and CI/CD. Serve data to dashboards and portals backed by Azure SQL, and work directly with clients to define requirements and metrics.

Requirements

Strong Python and SQL, with hands-on experience using pandas, PySpark and pytest. Production Azure Databricks experience with Delta Lake, Unity Catalog and Workflows. Experience with Azure Storage, Key Vault, managed identities and private networking. Practical experience with Terraform, Git and CI/CD using Azure DevOps or GitHub Actions, plus REST API ingestion and relational data modelling.

Experience in energy would be a bonus. Applications from other sectors are welcome.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.apply4u.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…