Senior Data Engineer

• Design, develop, and optimise data pipelines using PySpark and Databricks
• Build and maintain Lakehouse architecture leveraging Delta Lake
• Implement Delta Live Tables (DLT) for reliable, declarative pipeline development
• Enforce data quality, lineage, and access control using Unity Catalog
• Collaborate with Data Architects and ML Engineers on end-to-end platform design
• Translate complex business requirements into scalable technical solutions
• Contribute to best practices, code reviews, and internal engineering standards
• Engage directly with client stakeholders to provide technical guidance and updates

• Proven hands-on experience with Databricks in a commercial environment
• Strong PySpark and Python development skills
• Deep understanding of Delta Lake and medallion architecture patterns
• Experience with Delta Live Tables (DLT) pipeline development
• Familiarity with Unity Catalog for governance and data management
• Solid understanding of cloud platforms - Azure, AWS, or GCP
• Experience working with data warehousing, ETL/ELT patterns, and SQL
• Strong communication skills and ability to work in client-facing delivery environments

DESIRABLE/NICE TO HAVE

• Databricks Certified Professional or Associate certification
• Experience with MLflow or exposure to ML/AI workloads on Databricks
• Background in consultancy or professional services delivery
• Exposure to Databricks Partner ecosystem tooling

Primus Connect is recruiting a Senior Data Engineer on behalf of a leading data and analytics consultancy operating within the Databricks ecosystem. This is an exciting contract opportunity for an experienced engineer who can hit the ground running and make an immediate impact on enterprise-scale data platform projects.