> Markdown version of [/jobs/ext/1683718-senior-consultant-data-engineer-python-pyspark-aws](https://www.wearedevelopers.com/jobs/ext/1683718-senior-consultant-data-engineer-python-pyspark-aws). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Consultant, Data Engineer (Python/PySpark/AWS) - **Company:** Infinitive - **Location:** Ashburn, VA, United States - **Experience:** Expert - **Salary:** $90,000.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Automation of Tests, Microsoft Azure, Batch Processing, Big Data, Cloud Computing, Program Optimization, Computer Programming, Continuous Integration, Data Architecture, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Warehousing, Database Design, Github, Python (Programming Language), Software Deployment, Data Streaming, Data Processing, Data Storage Management, Google Cloud, Git, Containerization, Pyspark, Kubernetes, Information Technology, Software Version Control, Data Pipelines, Docker, Jenkins - **Published:** July 3, 2026 - **Apply:** https://www.careerjet.com/jobad/us152d14eb9036ea88ac9ebea08c6e9749 ## About the Role * Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. * Proven experience as a Data Engineer or similar role. * Strong programming skills in Python and expertise in PySpark for both batch and streaming data processing. * Hands-on experience with ETL tools and processes. * Familiarity with CI/CD tools such as Jenkins or GitHub Actions. * Solid understanding of data modeling, database design, and data warehousing concepts. * Excellent problem-solving and analytical skills. * Strong communication and collaboration skills. Preferred Skills: * Knowledge of cloud platforms such as AWS, Azure, or Google Cloud. * Experience with version control systems (e.g., Git). * Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes). * Understanding of data security and privacy best practices. ## Description We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients. Responsibilities: Data Architecture and Design: * Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions. * Develop data models and schema designs to optimize data storage and retrieval. ETL Development: * Implement ETL processes to extract, transform, and load data from various sources. * Ensure data quality, integrity, and consistency throughout the ETL pipeline. Python and PySpark Development: * Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts. * Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices. Data Integration: * Integrate data from different systems and sources to provide a unified view for analytical purposes. * Collaborate with data scientists and analysts to implement solutions that meet their data integration needs. Streaming and Batch Workflows: * Design and implement streaming workflows using PySpark Streaming or other relevant technologies. * Develop batch processing workflows for large-scale data processing and analysis. CI/CD Implementation: * Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines using Jenkins or GitHub Actions. * Automate testing, code deployment, and monitoring processes to ensure the reliability of data pipelines., MANTECH seeks a motivated, career and customer-oriented Data Engineer to join our team in Herndon VA. The Data Engineer will leverage their expertise with Python to support the cus… + 14 days ago ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Implementing continuous delivery in a data processing pipeline](https://www.wearedevelopers.com/videos/73-implementing-continuous-delivery-in-a-data-processing-pipeline) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)