> Markdown version of [/jobs/ext/1459733-data-engineer-python-pyspark-sql](https://www.wearedevelopers.com/jobs/ext/1459733-data-engineer-python-pyspark-sql). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer (Python / PySpark / SQL)

- **Company:** WilsonCTS
- **Location:** San Jose, CA, United States
- **Experience:** Experienced
- **Salary:** $104,000.0 - $145,600.0
- **Contract:** Temporary contract
- **Skills:** Agile Methodology, Big Data, Computer Programming, Information Engineering, Data Infrastructure, Database Development, Software Debugging, Distributed Computing Environment, Python (Programming Language), Machine Learning, Object-Oriented Software Development, Operational Databases, SQL Databases, Feature Engineering, Sql Optimization, System Availability, Pyspark, Data Analytics, Data Pipelines
- **Published:** July 27, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=ff44cd0ea5461857

## About the Role

* 5+ years of overall experience in Data Engineering, Data Analytics, or a related field.
 * 2+ years of hands-on experience developing enterprise-scale solutions using PySpark.
 * 4+ years of experience with data modeling and designing scalable data solutions.
 * Strong programming skills in Python, including object-oriented programming concepts.
 * Advanced SQL skills with experience querying and transforming large datasets.
 * Experience building and maintaining production data pipelines.
 * Strong troubleshooting and debugging skills in production environments.
 * Excellent communication and collaboration skills with technical stakeholders., * Experience supporting machine learning feature engineering pipelines.
 * Familiarity with large-scale distributed data processing environments.
 * Experience working in Agile development environments.
 * Passion for mentoring teammates and sharing technical knowledge.

## Description

* Design, build, and maintain scalable feature engineering pipelines for analytics and machine learning applications.
 * Develop efficient, incremental data pipelines using PySpark to process enterprise-scale datasets.
 * Create and optimize data models that support reporting, analytics, and predictive modeling.
 * Monitor production data pipelines, troubleshoot issues, and ensure high availability and data quality.
 * Collaborate closely with data scientists, analysts, and engineering teams to prioritize business requirements.
 * Write clean, maintainable, object-oriented Python code following best practices.
 * Optimize SQL queries and data processing workflows for performance and scalability.
 * Support continuous improvements to data infrastructure and pipeline reliability.
 * Mentor team members and promote best practices for feature engineering and data development.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1146-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)