Data Engineer
Talent Smart
Sheffield, United Kingdom
2 days ago
Role details
Contract type
Contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 156KJob location
Sheffield, United Kingdom
Tech stack
Information Engineering
Data Transformation
Performance Tuning
Spark
PySpark
Data Pipelines
Databricks
Job description
Data Engineer
We're supporting a leading enterprise financial services organisation in the search for an experienced Data Engineer to join a high-performing data team on an initial 6-month contract.
Contract Details:
- £600 per day
- Inside IR35
- Initial 6-month engagement
- Sheffield-based, 3 days per week on-site
Key Requirements:
- Strong hands-on experience with PySpark and Databricks
- Deep understanding of Spark performance optimisation, including lazy evaluation, column pruning, groupBy operations, and window functions
- Proven ability to troubleshoot and resolve Spark job performance issues
- Extensive experience designing, developing, and supporting enterprise-scale data pipelines
- Strong technical depth across modern data engineering platforms, tools, and technologies
- Experience working within complex, large-scale enterprise environments
This is an excellent opportunity to contribute to a major data transformation programme within a leading financial services organisation.
Additional information available on successful application.
Requirements
- Strong hands-on experience with PySpark and Databricks
- Deep understanding of Spark performance optimisation, including lazy evaluation, column pruning, groupBy operations, and window functions
- Proven ability to troubleshoot and resolve Spark job performance issues
- Extensive experience designing, developing, and supporting enterprise-scale data pipelines
- Strong technical depth across modern data engineering platforms, tools, and technologies
- Experience working within complex, large-scale enterprise environments
This is an excellent opportunity to contribute to a major data transformation programme within a leading financial services organisation.