Databricks Data Engineer

As a Senior Data Engineer, you’ll be responsible for:

• Building and maintaining scalable data pipelines within Databricks.
• Developing and optimising batch and streaming data workflows.
• Designing and implementing Lakehouse architectures and medallion data models.
• Implementing data quality, monitoring, and observability frameworks.
• Maintaining security, governance, and access control standards.
• Collaborating with Data Scientists and Analysts to deliver business-critical data products.
• Driving engineering best practice through code reviews and technical standards.
• Identifying platform optimisation and cloud cost reduction opportunities.
• Translating business requirements into scalable technical solutions.
• Contributing to tooling decisions, documentation, and continuous improvement initiatives.

• Proven experience as a Data Engineer within production environments.
• Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL.
• Experience building and supporting scalable ETL/ELT pipelines.
• Strong understanding of distributed data processing and data modelling.
• Cloud platform experience across Azure, AWS, or GCP.
• Experience implementing data quality frameworks and pipeline monitoring.

• Excellent communication and stakeholder engagement skills. Desirable Experience

• Databricks certification.
• Unity Catalog and Databricks Asset Bundles.
• Terraform or Bicep.
• dbt or similar transformation frameworks.
• Kafka, Event Hubs, or other streaming technologies.
• Retail, supply chain, or consumer goods industry experience.

• Salary up to £85,000.