Azure Data Engineer
Upon Dgh Recruitment Limited
Charing Cross, United Kingdom
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Charing Cross, United Kingdom
Tech stack
Azure
Big Data
Software as a Service
Databases
Continuous Integration
Information Engineering
Data Integration
ETL
Data Warehousing
Infrastructure as a Service (IaaS)
Information Lifecycle Management
Python
Microsoft SQL Server
Platform as a Service (PAAS)
Powerpivot
Powershell
Power BI
Azure
Scala
SharePoint
PL-SQL
Data Streaming
Enterprise Data Management
Microsoft Power Automate
Azure
Containerization
PySpark
Information Technology
Data Management
Azure
Data Pipelines
Serverless Computing
Databricks
Job description
You'll report to the Lead Data Engineer and join our Data Engineering Team, working alongside architects, analysts, testers and agile delivery squads., * Build and maintain scalable, automated data pipelines using Azure tools like Data Factory, Databricks and Logic Apps
- Ingest, transform and model data from multiple sources into our enterprise data platform
- Optimise data flows for performance, reliability and reusability
- Support data quality, reconciliation and monitoring processes
- Work across the full data lifecycle, from raw source to insight
Requirements
- SQL Server, Data Warehousing, Big Data, Power BI, ETL & BI platforms, Data modelling, Kimball Methodology, Master Data Services, Data Quality (DQ), Purview
- Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse
- Python, Scala, PySpark
- SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads
Desirable Experience
- PowerShell scripting, Agile delivery environments, CI/CD, IaaS / PaaS / SaaS, Containerisation, PoCs / pilots / prototypes, Semarchy (MDM), PL/SQL, Total Mobile, Total Repairs, Total Connect Repairs, * Degree or equivalent experience in: IT, Computer Science, Data Engineering, Related field
About the company
In accordance with the Employment Agencies and Employment Businesses Regulations 2003, this position is advertised based upon DGH Recruitment Limited having first sought approval of its client to find candidates for this position.
DGH Recruitment Limited acts as both an Employment Agency and Employment Business