Lead Data Platform Engineer
Harnham
Manchester, United Kingdom
8 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 85KJob location
Remote
Manchester, United Kingdom
Tech stack
API
Automation of Tests
Azure
Continuous Integration
Data Integration
DevOps
Hive
Python
SQL Databases
Data Logging
Azure
PySpark
Databricks
Job description
You will focus on the design, build and optimisation of the Azure Databricks Lakehouse platform, ensuring it is scalable, secure and reliable. You will work closely with engineers and stakeholders across the business, providing technical leadership and taking ownership of key data platform initiatives., * Developing and deploying the Lakehouse platform in Azure.
- Owning Databricks engineering, administration and platform optimisation.
- Designing end-to-end data platform solutions
- Leading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory.
- Creating and maintaining CI/CD pipelines and automated testing frameworks.
- Developing APIs to support integration
- Implementing monitoring, logging and alerting for platform reliability.
Requirements
- Deep expertise in Databricks, PySpark, Python and SQL.
- Proven experience designing and delivering Lakehouse solutions.
- Strong DevOps capabilities, including CI/CD and automated testing.
- Experience with Infrastructure as Code and cloud automation.
- Familiarity with monitoring, logging and alerting tools.
- Strong stakeholder engagement and the ability to work across teams.
- Experience with APIs and data integration methods.
- Azure Data Factory experience is beneficial.
Benefits & conditions
You will receive a salary, dependent on experience. Salary is up to £85,000 On top of the salary there are some fantastic extra benefits.
About the company
This client are a well-established organisation with a strong engineering culture and a growing Data and Machine Learning function. The team is collaborative, supportive and operates with solid engineering principles at its core. With flexible-by-choice working, a positive work-life balance and a commitment to technical excellence, this is an environment where you can make a visible impact while continuing to grow your expertise