Platform Engineer

We are seeking an experienced Platform Engineer with strong expertise in Databricks and PySpark to join our team on a contract basis. This role is focused on platform optimisation, performance, and cost efficiency, ensuring our Databricks environment runs at its optimum level., * Manage and optimise the Databricks platform to ensure high performance and cost efficiency

• Analyse DBU consumption and drive improvements in platform utilisation
• Monitor and enhance PySpark pipeline performance
• Make informed decisions on scaling up/down clusters based on workload demands
• Establish and maintain automated release management processes
• Focus on operational excellence across the platform environment
• Gather performance data and provide clear evidence-based insights to stakeholders and Databricks teams

• Strong hands-on experience with Databricks platform engineering
• Solid expertise in PySpark and performance tuning
• Proven experience optimising data pipelines and platform costs
• Experience with cluster management and scaling strategies
• Ability to analyse performance metrics and present findings effectively
• Familiarity with platform operations and reliability best practices, * Industry experience in Trading & Supply is not required
• This is an optimisation-focused role, rather than development-heavy

If you're passionate about performance optimisation, cost efficiency, and platform engineering within Databricks, we'd love to hear from you.

Deloitte drives progress. Our firms around the world help our clients become market leaders wherever they compete. Deloitte invests in outstanding people with diverse talents and backgrounds, empowering them to achieve more than they can elsewhere. Our work combines consulting with action and integrity. We believe that when our clients and society are stronger, so are we.