Data Engineer

We are looking for a passionate Data Engineer to bring their knowledge and experience to our team and help drive forward the Data Engineering function. You will help design and contribute to the development of a robust, managed and accessible data foundation., · Comfortable creating data pipeline architecture and RESTful Api interfaces as part of a data solution

· Design, build and maintain end-to-end data pipelines for multi-tenant data processing system using python, databricks SDK and databricks workflows

· Design and maintain multi-tenant data processing systems.

· Integrate with Azure cloud services (inc Storage, Service Bus, Monitor, Key Vault)

· Build and maintain Docker containers and manage applications on Kubernetes.

· Maintain Azure DevOps build and deployment pipelines for CI/CD.

· Manage data quality, monitor accuracy and completeness, and advise ways that data quality can be improved.

· Identify, root cause analysis, and fix incidents related to data management

· Performance monitor data and reporting platforms

· Work as part of a team to deliver projects to meet the needs of the business

· Routinely provide status updates to colleagues and stakeholder groups

Do you have experience in Internal audits?, Do you have a Master's degree?, To succeed in this Data Engineering role, you should have strong analytical skills and the ability to combine data from many different sources. Required Data Engineer skills also include familiarity with key programming languages and knowledge of best practice development and approaches.

If you are detail-oriented, with excellent organisational skills and experience in this field, we'd love to hear from you., · Advanced programming knowledge of Python including the FastAPI Framework and Object Oriented Programming.

· Proven experience working with PySpark and Spark SQL for data transformation.

· Proven experience working with Azure cloud services specifically in Azure Data Factory, Storage, Service Bus and Azure Monitor or similar on AWS/GCP.

· Containerisation and orchestration using docker and Kubernetes

· Strong understanding of databricks workflow orchestration, data validation patterns.

· Strong understanding of multi-tenant architecture and event driven architecture.

· Experience with SQL database design, normalisation.

· Hands on experience with DevOps and CI/CD.

· Experience working with data visualization tools and techniques.

· Strong problem-solving skills and attention to detail.

· Excellent communication and collaboration skills.

· Be able to clearly document and communicate complex data concepts to a varied audience.

It's a bonus if you have

• Proven experience of Databricks especially around data ingest and pipelines.
• Experience in Data Science and Machine Learning models
• Data Engineering certifications
• Experience within hospitality, retail, payments or other guest facing systems
• Excellent communication and stakeholder management
• Degree in Computer Science, IT, or similar field; a Master's is a plus

Imagine what it would be like to work for the UK's leading tech developer to the UK's biggest and best pubs and restaurants? From EPoS to loyalty, CRM to table bookings, stock control, recipe management and BI Reporting giving business critical insights - our tech includes everything an operator needs to run their hospitality business.