PySpark Developer (MS Fabric, DW) - Outside IR35
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
We are seeking a highly capable PySpark Developer to play a key role in a major data platform modernisation programme for our leading manufacturing client in the West Midlands. The successful candidate will be responsible for helping to replace and modernise a business-critical Data Warehouse that has evolved over the last ten years and now underpins the majority of finance reporting across the organisation.
Working within a Physical Data Hub environment, you will be responsible for developing, testing and validating data solutions whilst transposing existing Gold Layer logic and data processes into a modern Microsoft Fabric architecture.
This role requires a strong, hands-on developer who can quickly understand complex existing solutions, work independently, and deliver high-quality outcomes with minimal supervision.
Requirements
- Strong commercial experience developing solutions using PySpark - expert level.
- Experience working with Microsoft Fabric.
- Experience with complementary technologies such as Databricks, Azure Data Factory, Lakehouse architectures or similar modern cloud data platforms.
- Strong understanding of Data Warehousing concepts, ETL/ELT patterns and data modelling.
- Experience migrating or modernising legacy Data Warehouse environments.
- Excellent SQL skills and the ability to interpret and troubleshoot complex transformation logic.
- Strong understanding of data quality, validation and testing practices.
- Experience working within structured development environments with source control, code reviews and deployment processes.
- Ability to quickly understand existing solutions and independently deliver enhancements or replacements.
- Knowledge of Medallion Architecture (Bronze, Silver, Gold layers).
- Manufacturing sector experience., * Datawarehousing
- PySpark Developer
- MS Fabric
About the company
TXP takes great pride in representing socially responsible clients who not only prioritise diversity and inclusion but also actively combat social inequality. Together, we have the power to make a profound impact on fostering a more equitable and inclusive society. By working with us, you become part of a movement dedicated to promoting a diverse and inclusive workforce
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…