> Markdown version of [/jobs/ext/2229341-data-engineer-aws-pyspark](https://www.wearedevelopers.com/jobs/ext/2229341-data-engineer-aws-pyspark). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - AWS & PySpark - **Company:** Cliff Services Inc - **Location:** Dallas, TX, United States - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Amazon S3, Big Data, Data as a Services, Extract Transform Load (ETL), Data Transformation, Data Systems, Distributed Computing Environment, Python (Programming Language), Cloud Services, Standard Sql, Data Processing, Cloud Platform System, Pyspark, Data Pipelines - **Published:** August 25, 2026 - **Apply:** https://www.dice.com/job-detail/a65d4e0a-92f5-44f4-8d18-3734d643ffa9 ## About the Role We are looking for an experienced Data Engineer with strong hands-on expertise in AWS and PySpark. The ideal candidate must have prior professional experience working with Banking domain and be capable of developing scalable data pipelines and data processing solutions in a cloud environment., * Strong hands-on experience with PySpark. * Strong experience with AWS cloud services. * Experience developing ETL/data pipelines and processing large datasets. * Strong Python and SQL skills. * Experience with data transformation, integration, and data quality. * Mandatory: Prior Capital One project/client experience. * Strong communication and problem-solving skills. Preferred * Experience with AWS data services such as S3, Glue, EMR, Lambda, Redshift, or similar. * Experience with distributed data processing and cloud-based data platforms. * Financial services/banking domain experience. ## Description * Design, develop, and maintain scalable data pipelines using PySpark and AWS. * Develop and optimize large-scale data processing and ETL workflows. * Work with AWS cloud services to build reliable and high-performance data solutions. * Perform data transformation, cleansing, validation, and integration. * Optimize PySpark jobs for performance, scalability, and cost efficiency. * Collaborate with data architects, analysts, developers, and business stakeholders. * Troubleshoot data pipeline issues and ensure data quality and reliability. * Follow engineering best practices for code development, testing, deployment, and documentation. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)