Data Engineer - Azure Databricks / Python - remote
MYO Talent
Solihull, United Kingdom
6 days ago
Role details
Contract type
Temporary to permanent Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 130KJob location
Remote
Solihull, United Kingdom
Tech stack
API
Unit Testing
Azure
Data Cleansing
Data Governance
Data Transformation
Python
Metadata
Data Logging
Data Ingestion
Data Lake
PySpark
Databricks
Job description
- Define and build a data lake architecture on Azure (ADLS + Databricks)
- Implement layered data model (bronze / silver / gold) for ingestion, processing, and reporting
- Develop ingestion patterns from API sources (batch and streaming)
- Establish data governance, metadata, and access controls
- Define storage structures, naming conventions, and schema design
- Develop API connectors and ingestion pipelines using Python
- Implement integration services feeding into the Databricks environment
- Build data transformation logic using PySpark / Python (data cleansing, standardisation, validation)
- Configure monitoring, logging, and alerting
- Execute unit and integration testing across pipelines
Requirements
- Azure
- Databricks
- Python
- Desirable - any exposure to Financial Services sector - Insurance or Banking etc
Benefits & conditions
Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / 2-3 month contract / Outside IR35 / Fully remote / £350 - 500 per day.
One of our leading clients is looking to recruit a Data Engineer.
Location - fully remote / home based
Duration - 2-3 months plus possible extension
Day Rate - £350-500 per day Outside IR35