Lead Data Engineer
JLA Resourcing Ltd
Southampton, United Kingdom
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 75KJob location
Southampton, United Kingdom
Tech stack
Artificial Intelligence
Azure
Cloud Computing
Log Analysis
Machine Learning
Power BI
Azure
Kafka
Data Management
Stream Analytics
Data Pipelines
Databricks
Job description
- As the Lead Data Engineer, I will take a proactive role in delivering next-generation data platforms. I will manage and mentor the existing team member and steer the design, development, and governance of the data pipelines. I will work closely with stakeholders across the technology function and within the business to ensure the availability, integrity, and compliance of our systems. I'll take ownership of the core architecture and engineering within our new Azure Databricks ecosystem, ensuring that the data platform architecture supports our availability and growth targets. Additionally, I will leverage advances in AI and Machine Learning capabilities and collaborate with our 3rd Party Data Partner to select, implement, and manage technology improvements.
Technologies:
- AI
- Azure
- Cloud
- Databricks
- Kafka
- Machine Learning
- Unity
- GameDev
More:
We are seeking a forward-thinking individual who is always asking, Whats next?-constantly exploring new tools or functionalities that can help drive our business forward. This is a fantastic opportunity to make a significant impact in our Digital Transformation Programme, and I am excited to find someone who shares our vision and passion for innovation.
Requirements
- In-depth experience in modern data solution architecture design and delivery in a hybrid cloud environment, predominantly Azure/Databricks.
- Experience in pipeline orchestration management.
- Strong experience with Databricks.
- Experience implementing machine learning and AI.
- Familiarity with tools such as Purview and Unity Catalog, along with observability tools like Monte Carlo, Fabric Monitoring, and Log Analytics.
- Mentoring, leading, or management experience, initially with a small team, with aspirations for growth.
- Ideally, skills in Delta Live Tables, Kafka, Azure Stream Analytics, Azure ML, PowerBI, and Financial Modelling.