Lead Data Engineer

JLA Resourcing Ltd
Southampton, United Kingdom
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 75K

Job location

Southampton, United Kingdom

Tech stack

Artificial Intelligence
Azure
Cloud Computing
Log Analysis
Machine Learning
Power BI
Azure
Kafka
Data Management
Stream Analytics
Data Pipelines
Databricks

Job description

  • As the Lead Data Engineer, I will take a proactive role in delivering next-generation data platforms. I will manage and mentor the existing team member and steer the design, development, and governance of the data pipelines. I will work closely with stakeholders across the technology function and within the business to ensure the availability, integrity, and compliance of our systems. I'll take ownership of the core architecture and engineering within our new Azure Databricks ecosystem, ensuring that the data platform architecture supports our availability and growth targets. Additionally, I will leverage advances in AI and Machine Learning capabilities and collaborate with our 3rd Party Data Partner to select, implement, and manage technology improvements.

Technologies:

  • AI
  • Azure
  • Cloud
  • Databricks
  • Kafka
  • Machine Learning
  • Unity
  • GameDev

More:

We are seeking a forward-thinking individual who is always asking, Whats next?-constantly exploring new tools or functionalities that can help drive our business forward. This is a fantastic opportunity to make a significant impact in our Digital Transformation Programme, and I am excited to find someone who shares our vision and passion for innovation.

Requirements

  • In-depth experience in modern data solution architecture design and delivery in a hybrid cloud environment, predominantly Azure/Databricks.
  • Experience in pipeline orchestration management.
  • Strong experience with Databricks.
  • Experience implementing machine learning and AI.
  • Familiarity with tools such as Purview and Unity Catalog, along with observability tools like Monte Carlo, Fabric Monitoring, and Log Analytics.
  • Mentoring, leading, or management experience, initially with a small team, with aspirations for growth.
  • Ideally, skills in Delta Live Tables, Kafka, Azure Stream Analytics, Azure ML, PowerBI, and Financial Modelling.

Apply for this position