Data Engineer

Summary:My market leading client are looking to secure the services of a contract based Data Engineer to assist with critical project work over the coming months. Ideally coming from a consultancy background with extensive experience working in secure and regulated environments. Experience and knowledge of working in a public sector environment is essential. Key ResponsibilitiesStrong stakeholder engagement and collaboration.Design, build and maintain scalable data pipelines.Develop using Azure Databricks (PySpark, Spark SQL, Python).Contribute to Lakehouse architecture (Delta Lake patterns, Databricks capabilities).Build and manage workflows (Databricks Workflows, Delta Live Tables).Implement data governance (Unity Catalog - access, discovery, control).Support analytics/reporting using Databricks SQL.Ingest and transform API, structured, semi-structured and geospatial data.Write clean, testable, maintainable code.Contribute to agile delivery (ceremonies, peer reviews, planning). Key Skills & ExperienceStrong Data Engineering experience with Azure Databricks.Proven delivery of production-grade data pipelines.Strong Python, SQL, PySpark and Spark SQL capability.Experience with Lakehouse / modern data platform design.Hands-on with Databricks tools (Unity Catalog, Workflows, Delta Live Tables, Databricks SQL).Data ingestion from APIs and external sources.Geospatial data processing experience (real-world use cases).Experience with geospatial formats (Shapefile, GeoParquet, GeoPackage, GeoTIFF).Knowledge of Apache Sedona or similar frameworks.Understanding of data modelling, quality, monitoring and optimisation.Experience with version control, CI/CD and cloud environments.Strong analytical and problem-solving skills.

Duration: 3 MonthsLocation: RemoteRate: £450 - £470 per day DOEStatus: OUTSIDE IR35Clearance: Eligible for SCStart Date: ASAP