> Markdown version of [/jobs/ext/1168687-it-technology-lead-big-data-data-processing-spark](https://www.wearedevelopers.com/jobs/ext/1168687-it-technology-lead-big-data-data-processing-spark). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# IT - Technology Lead | Big Data - Data Processing | Spark

- **Company:** Cloudspace LLC
- **Location:** Charlotte, NC, United States
- **Experience:** Expert
- **Salary:** $135,200.0 - $145,600.0
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Business Logic, Big Data, Data Transformation, Python (Programming Language), Object-Oriented Software Development, Software Engineering, Data Processing, Apache Spark, Pyspark, Software Coding
- **Published:** July 3, 2026
- **Apply:** https://www.careerjet.com/jobad/us4a8d306e1b0fa8d7e829748d2c4fee7f

## About the Role

We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic.
Proficient in Python, PySpark, and Object-oriented programming concepts.
Proven experience as a Senior Data Engineer or similar role.
Strong problem-solving techniques with an ability to troubleshoot complex software issues.
Experience with AWS is preferred, but not mandatory.
Excellent communication skills, both written and verbal.
Self-motivated and able to work independently with minimal supervision.
Minimum Years of Experience:
8 years
Certifications Needed:
Top 3 responsibilities you would expect the Subcon to shoulder and execute



## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [Let's Get Aggregated: Custom UDAFs in Spark  ](https://www.wearedevelopers.com/videos/1649-let-s-get-aggregated-custom-udafs-in-spark)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [A Guide to Green Tech and Green IT Careers](https://www.wearedevelopers.com/magazine/374-a-guide-to-green-tech-and-green-it-careers)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)