> Markdown version of [/jobs/ext/2549070-pyspark-developer](https://www.wearedevelopers.com/jobs/ext/2549070-pyspark-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# PySpark Developer

- **Company:** INFT Solutions inc
- **Location:** United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Amazon S3, Data Analysis, Big Data, Continuous Integration, Apache Hadoop, Apache Hive, Python (Programming Language), SQL Databases, Data Processing, Apache Spark, Electronic Medical Records, Gitlab, Pandas, Data Lakes, Pyspark, Terraform, Web Api
- **Published:** August 6, 2026
- **Apply:** https://www.dice.com/job-detail/b84545b5-ebbe-4672-893f-5052b84c3927

## About the Role

Strong development skills and significant experience in Data Lakes, PySpark, Pandas, and AWS pipelines.

Qualifications

10+ years hands-on Python development experience for big data application.

Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.

Strong development experience in AWS platforms/services such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.

Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.

Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.

Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.

Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusions

Collaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organization

Possess strong analytical and problem-solving skills

Skills

Required 10+ years of Python development experience for big data application

Required 5+ years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, Glue

Required 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization

Hands on experience with CI/CD pipeline tools such as Gitlab/Terraform



## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Web APIs you might not know about](https://www.wearedevelopers.com/videos/281-web-apis-you-might-not-know-about)
- [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more)
- [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)
- [Project Fugu: Extending the web](https://www.wearedevelopers.com/videos/832-project-fugu-extending-the-web)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)