Data & Analytics Engineer, £450 per day inside IR35
Bench IT
Uttoxeter, United Kingdom
2 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 117KJob location
Uttoxeter, United Kingdom
Tech stack
Data analysis
Continuous Integration
Data Governance
Hive
SQL Databases
Data Streaming
Tableau
Data Processing
Snowflake
Spark
Caching
GIT
Data Lake
PySpark
Data Lineage
Terraform
Data Pipelines
Databricks
Job description
- Build and maintain batch and streaming data pipelines using PySpark and Spark SQL
- Develop data models across bronze, silver, and gold layers
- Implement incremental loading and CDC patterns for efficient data processing
- Optimise data performance (partitioning, caching, Z-Ordering, etc.)
- Orchestrate workflows using Databricks Jobs
- Create curated datasets and dimensional models for analytics and reporting
- Support BI tools such as Tableau
- Ensure data quality, testing, and observability (alerts, metrics, runbooks)
- Collaborate on CI/CD pipelines using Git and Terraform
- Implement data governance and security using Unity Catalog
- Produce clear documentation (data lineage, ownership, SLAs, data contracts)
Requirements
- Strong experience with Databricks (Workspaces, Jobs, SQL Warehouses, Repos)
- Hands-on expertise in Spark/PySpark/Spark SQL
- Experience with Delta Lake and data optimisation techniques
- Knowledge of Delta Live Tables (DLT) or streaming pipelines
- Strong SQL and data modelling (star/snowflake schemas) skills
- Experience with CI/CD, Git workflows, and Infrastructure as Code (Terraform)
- Strong communication and documentation skills
- Ability to work collaboratively across engineering, analytics, and business teams
- Attention to detail and a focus on data quality and reliability
