Sr Data / ML Engineers (PySpark / Databricks / Healthcare Claims)

Cognizant Technology Solutions Corporation
Frankfort, United States of America
11 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 117K

Job location

Remote
Frankfort, United States of America

Tech stack

Azure
Continuous Integration
Data Validation
Information Engineering
Data Governance
ETL
Data Structures
DevOps
Meta-Data Management
Performance Tuning
SQL Databases
Cloud Platform System
Feature Engineering
Spark
Caching
PySpark
Optimization Algorithms
Health Level Seven International
Data Lakehouse
Data Delivery
Software Version Control
Data Pipelines
QNXT
Databricks

Job description

  • Design, build, and maintain scalable data pipelines using PySpark based ETL, SQL, and Databricks.
  • Implement and enhance medallion architecture (Bronze/Silver/Gold) for structured, governed data delivery.
  • Develop and enforce data quality frameworks, validation rules, and monitoring processes.
  • Optimize Spark jobs for performance, reliability, and cost efficiency.
  • Collaborate with cross-functional teams including data architects, analysts, and business stakeholders.
  • Translate healthcare business requirements into robust technical solutions.
  • Ensure compliance with healthcare data standards, privacy regulations, and governance practices.
  • Claims ingestion and orchestration
  • Data validation and transformation
  • Supporting batch and event-driven workflows
  • Feature engineering

Requirements

We are seeking a highly skilled Senior Data Engineer with strong expertise in PySpark, SQL, and Databricks to support the design, development, and optimization of large-scale data pipelines. The ideal candidate will have hands-on experience with medallion architecture, data quality frameworks, and Spark performance tuning. Healthcare domain knowledge is essential for success in this role., * Strong hands-on experience with PySpark based ETL , SQL , and Databricks

  • Deep understanding of medallion architecture and modern data lakehouse patterns.
  • Experience implementing data quality frameworks and automated validation.
  • Proficiency in Spark optimization techniques (partitioning, caching, AQE, cluster tuning).
  • Familiarity with CI/CD, version control, and DevOps practices for data engineering.

Healthcare Domain Expertise

  • Experience working with healthcare claims platforms such as Facets , QNXT , or Health Rules .
  • Understanding of CPT, ICD-10, HCPCS, and related healthcare coding standards.
  • Knowledge of claims lifecycle, adjudication processes, and provider/member data structures.
  • Ability to interpret healthcare data models and ensure accurate mapping, transformation, and enrichment., * Experience in cloud environments (Azure preferred).
  • Exposure to data governance, MDM, and metadata management.
  • Strong analytical, communication, and problem-solving skills.
  • Ability to work independently and drive technical decisions.

Work model

We strive to provide flexibility wherever possible. Based on this role's business requirements, this is a remote position open to qualified applicants in the United States. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

Benefits & conditions

The annual salary for this position is between $ 100,000 K -$ 117,000 K depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

Medical/Dental/Vision/Life Insurance

Paid holidays plus Paid Time Off

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Apply for this position