> Markdown version of [/jobs/ext/2912952-pyspark-developer](https://www.wearedevelopers.com/jobs/ext/2912952-pyspark-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# PySpark Developer

- **Company:** Integrated Technology Corporation
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Agile Methodology, Airflow, Amazon Web Services, Apache HTTP Server, Big Data, Continuous Integration, Data Architecture, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Transformation, DevOps, Identity and Access Management, Python (Programming Language), Metadata, Performance Tuning, Query Optimization, Standard Sql, Cloudera, SQL Databases, Unstructured Data, Apache Spark, Git, Amazon Relational Database Service, Data Lakes, Pyspark, Information Technology, Apache Kafka, Cloudwatch
- **Published:** September 15, 2026
- **Apply:** https://www.dice.com/job-detail/2af75a11-3df4-433d-b5c7-79e4ad20d906

## About the Role

* 10+ years IT experience; 6+ years in Data Engineering/Big Data
 * Strong hands-on PySpark/Spark development
 * Experience with Cloudera Data Platform (CDP)
 * Strong knowledge of Apache Iceberg and Data Lake/Lakehouse architecture
 * Experience with Apache Airflow
 * Strong SQL, ETL/ELT, and data modeling skills
 * Large-scale structured/unstructured data processing
 * Git, CI/CD, and DevOps practices
 * Performance tuning, partitioning, and query optimization

Preferred:

 * AWS: S3, Glue, Lambda, EMR, ECS/EKS, RDS, IAM, CloudWatch
 * Kafka/event-driven processing
 * Python/Java development
 * Data quality, metadata, and governance
 * Healthcare/Medicaid/Claims/Insurance experience
 * Agile and cloud migration/modernization experience
 * AWS or Cloudera certification

## Description

Seeking a Senior PySpark Developer with strong experience in PySpark, Cloudera CDP, Apache Iceberg, Airflow, SQL, and AWS to support a large-scale cloud transformation and data modernization initiative.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment)

## Related Articles

- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Everything a Developer Needs to Know About MCP with Neo4j](https://www.wearedevelopers.com/magazine/604-everything-a-developer-needs-to-know-about-mcp-with-neo4j)