> Markdown version of [/jobs/ext/3525077-data-engineer-python-pyspark-and-sql](https://www.wearedevelopers.com/jobs/ext/3525077-data-engineer-python-pyspark-and-sql). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer Python, PySpark, and SQL

- **Company:** Capgemini
- **Location:** Northampton, UK (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Mining, Data Warehousing, DevOps, Distributed Computing Environment, Revision Control Systems, Python (Programming Language), Performance Tuning, Query Optimization, Standard Sql, SQL Databases, Enterprise Data Management, Data Processing, Pyspark, Data Analytics, Data Pipelines
- **Published:** October 1, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/data-engineer-python-pyspark-and-sql/49637924

## About the Role

datasets and distributed computing frameworks to support data engineering initiatives.* Collaborate with architects, analysts, and business stakeholders to deliver data-driven solutions.* Troubleshoot and resolve performance, scalability, and data quality issues.* Contribute to data platform modernization and best practices.**Skills*** 7-9 years of experience in Data Engineering or related roles.* Strong hands-on experience in Python development.* Proven experience with PySpark for large-scale data processing.* Strong knowledge of SQL, including query optimization and performance tuning.* Exposure to or working knowledge of Scala.* Experience working with cloud-based or enterprise data platforms.* Strong analytical, problem-solving, and communication skills.**Preferred Skills*** Experience with data warehousing and ETL frameworks.* Exposure to cloud platforms such as Azure, AWS, or GCP.* Familiarity with DevOps, CI/CD, and version control tools.**We are a Disability Confident

## Description

**Job Title**: **Data Engineer** **Python, PySpark, and SQL****Location**: Northampton**About the Job you are considering:**We are seeking an experienced Data Engineer with strong expertise in Python, PySpark, and SQL to design, develop, and optimize large-scale data processing solutions. The ideal candidate will have hands-on experience building data pipelines, working with big data technologies, and exposure to Scala in enterprise data environments.**Hybrid working:**The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.**Your Role:*** Design, develop, and maintain scalable data pipelines and ETL processes.* Develop and optimize data processing solutions using Python and PySpark.* Write complex and high-performing SQL queries for data extraction, transformation, and analysis.* Work with large


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)