> Markdown version of [/jobs/ext/4825760-senior-data-engineer-python-spark-pyspark-aws](https://www.wearedevelopers.com/jobs/ext/4825760-senior-data-engineer-python-spark-pyspark-aws). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer (Python, Spark, PySpark, AWS) - **Company:** CVS Health - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $83,430 - $203,940 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Amazon Web Services, Big Data, Cloud Computing, Cloud Engineering, Code Generation, Software Quality, Code Review, Continuous Integration, Information Engineering, Data Integration, Extract Transform Load (ETL), Relational Databases, Database Queries, Database Storage Structures, Python (Programming Language), Microsoft SQL Server, Performance Tuning, Scrum Methodology, Software Engineering, SQL Stored Procedures, SQL Databases, Data Processing, Apache Spark, Git, Cloudformation, Pyspark, Information Technology, Restful APIs, Terraform, Code Restructuring, Software Version Control, Data Pipelines, Docker, Databricks - **Published:** November 21, 2026 - **Apply:** https://dejobs.org/x/x/05BDDF28A69242FCBCADE39D553DB9D9/job/ ## About the Role We are looking for a Data Engineer with 3-5 years of experience to build and support scalable data pipelines and data-processing solutions in a cloud environment. The ideal candidate will have strong hands-on experience with AWS, Databricks, Apache Spark/PySpark, Python, and SQL and be comfortable working with large, complex datasets. This role requires strong technical problem-solving skills, experience working in Agile teams, and the ability to independently deliver high-quality solutions while collaborating across engineering, product, and business stakeholders. Experience leveraging AI-assisted development tools to improve productivity and code quality is expected., * 3-5 years in data engineering * 2+ years hands-on experience with: * AWS cloud services and cloud-native application development * Databricks/Python/Spark/PySpark development * SQL Server/Lakehouse/ETL patterns and relational database design and development * RESTful APIs and distributed application architectures * Background supporting risk-adjustment, actuarial, or finance workloads (reconciliation, point-in-time history, auditability). * Experience within healthcare, health insurance, or other regulated industries and a strong understanding of PHI, HIPAA, and controls appropriate to revenue and CMS-submission data. Preferred Qualifications * Experience with Infrastructure as Code (Terraform, CloudFormation, or similar tools). * Familiarity with containerization and orchestration technologies such as Docker and Kubernetes. * Exposure to application observability, monitoring, and performance optimization tools. * AWS certifications or other relevant cloud certifications., Bachelor's degree in computer science, Engineering, Information Technology, or related field, or equivalent experience ## Description * Become familiar with enterprise data/IT policies on Databricks (or equivalent) lakehouse standards: Spark/PySpark, orchestration, Git-based source control, CI/CD, access control, and cost/performance. * Work with other data engineers and engineering practices for a regulated, sensitive environment. * Integrate with cross-functional teams including product owners, architects, QA engineers, data engineers, and business stakeholders. * Design and optimize database structures, complex queries, stored procedures, and data integration processes following established development standards and best practices. * Leverage AI-assisted development tools for code generation, refactoring, testing, documentation, and productivity improvements while ensuring appropriate validation and governance. * Conduct troubleshooting efforts, perform root cause analysis, and resolve complex application and data issues. * Perform code reviews and contribute to continuous improvement of engineering practices, quality standards, and development processes. * Participate in Agile/Scrum ceremonies, sprint planning, estimation, backlog refinement, reviews, and retrospectives.