> Markdown version of [/jobs/ext/564531-pyspark-spark-data-pipeline](https://www.wearedevelopers.com/jobs/ext/564531-pyspark-spark-data-pipeline). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# PySpark/Spark Data Pipeline

- **Company:** Computer Enterprises, Inc.
- **Location:** Pittsburgh, PA, United States
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Business Logic, Data Validation, Dataspaces, Software Debugging, Linux, Apache Hadoop, Python (Programming Language), Object-Oriented Software Development, Performance Tuning, SQL Databases, Apache Spark, Git, Pandas, Pyspark, Data Pipelines, Jenkins
- **Published:** June 12, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=b0e894b46fd233ab

## About the Role

Do you have experience in System performance optimization?, * Strong Spark + SQL transformation skills

 * Rigorous data validation & reconciliation mindset
 * Ability to translate STM/business logic into working pipelines
 * Experience operating in structured, governed data ecosystems
 * Practical debugging and performance optimization skills
 * Python, SQL, Git and Linux skills are required.
 * experience in working with wrangling data and building data pipelines

Preferred Skills

 * Preferrable experience in Jenkins, Apache Spark & Hadoop (Pandas is also good too), and object oriented programming.
 * Flex Skills Knowledge of AI space, acceleration enhancements and improvements.
 * Experience with Co-Pilot or AI code enablement functionality.

#INDGEN
#ZR

## Description

Participate on daily scrum calls for upcoming change release implementations - assigned work, status, questions, collaboration. Coding, testing, advancements, and modernization as a software developer.
Key Responsibilities

 * Participate on daily scrum calls for upcoming change release implementations - assigned work, status, questions, collaboration.
 * Coding, testing, advancements, and modernization as a software developer


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript)
- [Getting to Know Your Legacy (System) with AI-Driven Software Archeology](https://www.wearedevelopers.com/videos/1437-getting-to-know-your-legacy-system-with-ai-driven-software-archeology)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)

## Related Articles

- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)