> Markdown version of [/jobs/ext/506127-pyspark-python-data-engineer](https://www.wearedevelopers.com/jobs/ext/506127-pyspark-python-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Pyspark/Python Data Engineer

- **Company:** Tata Consultancy Services Limited
- **Location:** Irving, TX, United States
- **Experience:** Experienced
- **Salary:** $100,000.0 - $120,000.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Software Debugging, Distributed Computing Environment, Distributed Systems, Apache Hive, Python (Programming Language), Performance Tuning, Standard Sql, Data Processing, Snowflake, Git, Pyspark, Information Technology, Software Version Control, Data Pipelines
- **Published:** June 11, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=24d1bd66aacbed47

## About the Role

Do you have experience in Technical architecture?, Do you have a Bachelor's degree?, Must Have Technical/Functional Skills
We are looking for a skilled PySpark Data Engineer with strong hands-on experience in PySpark and Python to design, build, and optimize scalable data processing pipelines. The ideal candidate will have practical experience working with distributed data processing and a solid foundation in writing efficient, production-grade Python code
Required Technical Skills

 * Strong hands-on experience in PySpark (Spark SQL, DataFrame API)

 * Advanced proficiency in Python (data processing, performance tuning, modular coding)

 * Solid understanding of ETL design patterns and data pipeline architecture

 * Good working knowledge of SQL for data transformation and analysis

 * Experience with data processing in distributed environments

Preferred Skills (Good to Have)

 * Experience with cloud platforms (AWS preferred - S3, Glue, EMR or equivalent services)

 * Familiarity with workflow orchestration tools such as Airflow or similar schedulers

 * Exposure to data warehousing concepts (e.g., Snowflake or similar platforms)

 * Knowledge of code versioning (Git) and CI/CD practices

Experience

 * 3-8 years of experience in Data Engineering / PySpark development

 * Proven hands-on project experience in PySpark + Python

Roles & Responsibilities

 * Design, develop, and maintain ETL/ELT pipelines using PySpark

 * Write optimized and scalable PySpark transformations using DataFrames and Spark SQL

 * Develop reusable and efficient Python-based data processing components

 * Ensure data quality, integrity, and performance across pipelines

 * Perform debugging, performance tuning, and optimization of PySpark jobs, Qualifications : BACHELOR OF COMPUTER SCIENCE



## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)