> Markdown version of [/jobs/ext/2572525-python-pyspark-developer](https://www.wearedevelopers.com/jobs/ext/2572525-python-pyspark-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Python/PySpark Developer

- **Company:** SGA Inc.
- **Location:** Rutherford, NJ, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Big Data, Information Engineering, Extract Transform Load (ETL), Data Warehousing, Relational Databases, Database Queries, Information Lifecycle Management, JSON, Python (Programming Language), Software Engineering, YAML, GitHub Copilot, Spring-boot, Fastapi, Pyspark, Data Analytics, Apache Kafka, Databricks, Programming Languages, Microservices
- **Published:** August 31, 2026
- **Apply:** https://www.dice.com/job-detail/ada4cc3a-4b0f-400c-84de-cb59c4e34d4e

## About the Role

* 8+ years of overall experience in large-scale application development with recent mandatory platform for the secure and scalable deployment of AI agents into application contexts
 * Minimum of 5+ years of proven experience in a Python and pyspark Engineering lead role focused on building enterprise-grade, high-volume ELT/ETL processes using the PySpark.
 * Hands-on experience with YAML, JSON, FAST API or Spring boot, Github Copilot
 * Proven experience developing and automating microservice integrations to support data-intensive applications.
 * Proficiency in at least one programming language commonly used for data analytics, engineering, such as Python or Scala.
 * Strong SQL skills and experience with various relational databases.
 * Deep understanding of data modeling, data warehousing concepts, Data Mesh architecture, and data federation.
 * Excellent communication, collaboration, and problem-solving skills

## Description

Software Guidance & Assistance, Inc., (SGA), is searching for a Python/PySpark Developer for a right to hire assignment with one of our premier financial services clients in Rutherford, NJ ., * Design, develop, and maintain scalable, enterprise-grade AI agents , supporting ELT/ETL processes to handle large data volumes using the Python, FAST API, Microservices , PySpark, Kafka and Databricks ecosystem.

 * Develop, deploy, and automate microservice integrations to support data-intensive applications, ensuring scalability, resilience, and maintainability using cloud native infrastructure and openshift or Kubernates architecture including CI/CD pipelines.
 * Ensure data quality, integrity, and security throughout the entire data lifecycle.
 * Contribute to the continuous improvement of data engineering processes, standards, and best practices within the team.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions)
- [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)