Senior Platform Engineer (Databricks)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+9 more
Job description
- Design, build and enhance our Databricks platform, ensuring it remains secure, scalable and reliable.
- Develop and maintain batch and real-time data pipelines using Databricks, Spark and Delta Lake.
- Contribute to platform architecture, engineering standards and best practices across the data estate.
- Collaborate with Product, Analytics and Data Science teams to deliver solutions that solve real business problems.
- Support platform operations, monitoring and optimisation to ensure high levels of performance and reliability.
- Share knowledge with colleagues and help drive continuous improvement across the engineering team.
Requirements
- Proven experience building and supporting scalable, production-grade data platforms.
- Strong hands-on expertise with Databricks, Spark, Delta Lake, Python and SQL.
- Good understanding of cloud-based data engineering, ideally within Azure environments.
- Experience working with Infrastructure as Code tools such as Terraform, Bicep or similar.
- Solid understanding of data modelling, ETL/ELT processes, data quality, security and governance.
- Comfortable working with technical and non-technical stakeholders to deliver high-quality solutions., * Databricks certifications.
- Experience with Unity Catalog, MLflow or Databricks Asset Bundles.
- Familiarity with dbt or similar data transformation frameworks.
- Exposure to Kafka, Event Hubs or other streaming technologies.
- Experience working with retail or consumer packaged goods data, including point-of-sale, inventory or supply-chain datasets.
- A degree in Computer Science, Data Engineering or a related discipline, or equivalent practical experience.
Benefits & conditions
- Flexible Working - Enjoy a hybrid work model (typically 2 days in the office) with flexibility based on business needs, plus a work from anywhere policy to give you freedom to explore.
- Time Off - 25 days annual leave (+ bank holidays), increasing with length of service, plus an extra day off for your birthday! We also operate summer hours so you can make the most of the sunshine.
- Learning & Development - Access a vast range of courses through our learning platform and benefit from structured career progression plans to support your growth.
- Health & Wellbeing - Private Medical Insurance, a healthcare cash plan, and mental health support via Help@Hand. Plus, we’ll ensure you have a safe and productive home setup with a workspace assessment.
- Giving Back - Take paid volunteer days to support your local community, donate to your chosen charity through salary sacrifice (we’ll match it!), and make a difference with Give as You Earn.
- Extra Perks - A car purchase scheme to make buying a new car easier, plus access to additional benefits through our online platform, including gym and tech discounts.
Plus much more!
About the company
Help build the platform at the heart of Retail Insight’s data strategy
We’re looking for a Senior Platform Engineer to join our Data & Engineering team and play a key role in the development and evolution of our Databricks platform.
This is a senior, hands-on engineering role where you’ll design, build and optimise the data platform that powers our products and services. Working alongside Platform, Data and Product teams, you’ll help deliver scalable, secure and high-performance data solutions that enable analytics, machine learning and AI across the business.
If you enjoy solving complex technical challenges, working with modern cloud technologies and building robust data platforms at scale, we’d love to hear from you., An initial conversation with a member of our People Team to learn more about you, your experience and what you’re looking for in your next role. We’ll also tell you more about Retail Insight, the opportunity and what you can expect from the interview process.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
Top Big Data Technologies That You Need to Know
Software Engineer Salary London
Where To Find Software Engineering Jobs