Senior Data Engineer (Python, Spark, PySpark, AWS)

CVS Health
United States
1 day ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$83,430 - $203,940
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Amazon Web Services Big Data Cloud Computing Cloud Engineering Code Generation Software Quality Code Review Continuous Integration Information Engineering Data Integration Extract Transform Load (ETL)
+23 more
Relational Databases Database Queries Database Storage Structures Python (Programming Language) Microsoft SQL Server Performance Tuning Scrum Methodology Software Engineering SQL Stored Procedures SQL Databases Data Processing Apache Spark Git Cloudformation Pyspark Information Technology Restful APIs Terraform Code Restructuring Software Version Control Data Pipelines Docker Databricks

Job description

  • Become familiar with enterprise data/IT policies on Databricks (or equivalent) lakehouse standards: Spark/PySpark, orchestration, Git-based source control, CI/CD, access control, and cost/performance.
  • Work with other data engineers and engineering practices for a regulated, sensitive environment.
  • Integrate with cross-functional teams including product owners, architects, QA engineers, data engineers, and business stakeholders.
  • Design and optimize database structures, complex queries, stored procedures, and data integration processes following established development standards and best practices.
  • Leverage AI-assisted development tools for code generation, refactoring, testing, documentation, and productivity improvements while ensuring appropriate validation and governance.
  • Conduct troubleshooting efforts, perform root cause analysis, and resolve complex application and data issues.
  • Perform code reviews and contribute to continuous improvement of engineering practices, quality standards, and development processes.
  • Participate in Agile/Scrum ceremonies, sprint planning, estimation, backlog refinement, reviews, and retrospectives.

Requirements

We are looking for a Data Engineer with 3-5 years of experience to build and support scalable data pipelines and data-processing solutions in a cloud environment. The ideal candidate will have strong hands-on experience with AWS, Databricks, Apache Spark/PySpark, Python, and SQL and be comfortable working with large, complex datasets. This role requires strong technical problem-solving skills, experience working in Agile teams, and the ability to independently deliver high-quality solutions while collaborating across engineering, product, and business stakeholders. Experience leveraging AI-assisted development tools to improve productivity and code quality is expected., * 3-5 years in data engineering

  • 2+ years hands-on experience with:
  • AWS cloud services and cloud-native application development
  • Databricks/Python/Spark/PySpark development
  • SQL Server/Lakehouse/ETL patterns and relational database design and development
  • RESTful APIs and distributed application architectures
  • Background supporting risk-adjustment, actuarial, or finance workloads (reconciliation, point-in-time history, auditability).
  • Experience within healthcare, health insurance, or other regulated industries and a strong understanding of PHI, HIPAA, and controls appropriate to revenue and CMS-submission data.

Preferred Qualifications

  • Experience with Infrastructure as Code (Terraform, CloudFormation, or similar tools).
  • Familiarity with containerization and orchestration technologies such as Docker and Kubernetes.
  • Exposure to application observability, monitoring, and performance optimization tools.
  • AWS certifications or other relevant cloud certifications., Bachelor’s degree in computer science, Engineering, Information Technology, or related field, or equivalent experience

Benefits & conditions

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This full-time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well-being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Loading talks and stories from around this role…