Data Engineer Tester - Healthcare Data & AI Validation - Remote

NTT DATA Corporation
Philadelphia, PA, United States
1 day ago
Apply on careers-inc.nttdata.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
1 year minimum
Compensation
$93,816 - $131,500
Working hours
Regular working hours

Tech stack

Testing (Software) Agile Methodology Artificial Intelligence JIRA Audit Trail Automation of Tests Microsoft Azure Big Data Bioinformatics Health Informatics Software Bug Management Clinical Data Repository
+57 more
Hospital Information Systems Software Documentation Continuous Integration Data Auditing Data Validation Information Engineering Data Infrastructure Data Integrity Extract Transform Load (ETL) Data Mapping Data Transformation Data Structures Database Testing Programming Tools Distributed Computing Environment Distributed Systems Python (Programming Language) Load Testing Machine Learning Natural Language Processing Named Entity Recognition Scrum Methodology Regression Testing Standard Sql Requirements Traceability Software Engineering SQL Databases Test Data Test Management Strategies of Testing Unstructured Data Data Processing Graphics Processing Unit (GPU) Enterprise Software Applications Cloud Platform System Data Classification Performance Testing Data Ingestion Great Expectations (Foster Youth College-readiness and Support Program) Fast Healthcare Interoperability Resources Large Language Models Snowflake Test Scripts Model Validation Scalability Testing Git Pytest Pyspark Information Technology Data Lineage Health Level Seven International Hardware Acceleration Hardware Infrastructure Data Pipelines GXP Amazon Elastic Mapreduce (EMR) Databricks

Job description

We are seeking two experienced Data Engineer Testers to support the quality assurance, data integrity, and regulatory validation of an enterprise-scale medical data ingestion and automation platform.

These individuals will be responsible for designing and executing comprehensive testing strategies across complex ETL pipelines, large-scale data processing environments, and AI-driven data mapping solutions. The platform processes substantial volumes of structured and unstructured healthcare data, including clinical records, pathology reports, and other medical datasets.

The successful candidates will validate data ingestion, transformation, mapping accuracy, semantic alignment, and overall pipeline performance. A key component of the role will involve testing and validating outputs generated by Machine Learning models, Large Language Models (LLMs), and Natural Language Processing (NLP) technologies to ensure data accuracy and alignment with established healthcare standards and medical ontologies.

Candidates should bring a combination of hands-on data engineering, automated testing, big data quality assurance, and healthcare or life sciences domain experience., Data Pipeline & ETL Testing

  • Design, develop, and execute automated testing frameworks to validate complex ETL pipelines and large-scale data transformations.
  • Verify data accuracy, completeness, consistency, and integrity across ingestion, processing, transformation, and output stages.
  • Develop SQL and Python-based scripts to perform data reconciliation, validation, and automated quality checks.
  • Test data processing workflows across distributed environments and large-scale platforms.
  • Identify, document, and troubleshoot data discrepancies, transformation defects, and pipeline failures.

AI-Driven Data Mapping & Model Validation

  • Develop testing strategies to validate automated data mapping and semantic alignment generated by Machine Learning models and LLMs.
  • Verify AI-generated mapping outputs against established healthcare data standards, medical terminologies, and biomedical ontologies.
  • Evaluate mapping accuracy, precision, consistency, and completeness across diverse clinical and medical datasets.
  • Develop test datasets and validation benchmarks to assess model performance and identify mapping errors or inconsistencies.
  • Collaborate with Data Scientists and Machine Learning Engineers to investigate defects and improve model validation processes.

Performance, Load & Scalability Testing

  • Conduct performance, stress, and load testing across high-volume data ingestion and processing pipelines.
  • Benchmark data throughput, processing speed, resource utilization, and system responsiveness under varying workloads.
  • Validate distributed data processing performance across technologies such as PySpark, Databricks, Snowflake, and AWS EMR.
  • Assess pipeline performance in environments utilizing specialized AI hardware, including NVIDIA GPUs and Google TPUs.
  • Identify performance bottlenecks and collaborate with engineering teams to improve processing efficiency and scalability.

Unstructured Data & NLP Validation

  • Develop and execute test cases for NLP and Named Entity Recognition (NER) models processing unstructured clinical information.
  • Validate the accuracy of extracted medical entities, terminology, relationships, and clinical information from medical records and pathology reports.
  • Test entity recognition, classification, normalization, and semantic extraction outputs.
  • Verify that extracted information is correctly mapped to standardized medical terminologies and data structures.

Regulatory Compliance & Data Quality Assurance

  • Validate data lineage, traceability, audit logging, and security controls throughout the data processing lifecycle.
  • Ensure testing practices support applicable healthcare and life sciences regulatory and privacy requirements, including HIPAA, GDPR, and relevant GxP requirements.
  • Verify data handling, access controls, and documentation requirements within regulated healthcare data environments.
  • Maintain test documentation, execution evidence, defect records, and validation results to support auditability and compliance.

Test Management & Defect Resolution

  • Develop and maintain test plans, test cases, test scripts, and automated regression suites.
  • Track testing progress, defects, and resolution activities using Jira or Azure DevOps.
  • Collaborate with Data Engineers, Data Scientists, Machine Learning Engineers, and Business Analysts to resolve technical issues.
  • Participate in Agile development activities, including sprint planning, testing reviews, defect triage, and release readiness assessments.

Requirements

  • 3-5 years of professional experience in Data Testing, Data Engineering, Big Data Quality Assurance, or Software Testing focused on data-intensive applications.
  • 1-2+ years of experience within Healthcare, Life Sciences, Biotechnology, Pharmaceutical, or related regulated data environments.
  • Hands-on experience testing complex ETL pipelines, data transformations, and large-scale data processing workflows.
  • Strong SQL and Python programming skills for data validation, reconciliation, and test automation.
  • Experience validating structured and unstructured datasets and identifying data quality issues.
  • Understanding of automated data testing, regression testing, performance testing, and defect management.
  • Familiarity with healthcare data standards, clinical data models, and medical terminology.
  • Experience working with technical teams in Agile or enterprise software delivery environments.

Technical Skills & Qualifications

Data Engineering & Big Data Platforms

  • Strong SQL and Python programming capabilities.
  • Experience with PySpark, Databricks, Snowflake, and/or AWS EMR.
  • Understanding of distributed data processing, ETL architecture, data ingestion, and transformation workflows.
  • Experience testing large datasets across cloud-based data platforms.

Automated Testing & Data Validation

  • Hands-on experience with data quality and testing frameworks such as:

  • Great Expectations
  • dbt Testing
  • PyTest
  • Automated SQL-based validation frameworks
  • Git-based CI/CD testing and validation pipelines

Experience developing automated data reconciliation, regression, and quality assurance scripts.

AI/ML & Infrastructure Testing

  • Working knowledge of Machine Learning, LLMs, NLP, and AI-assisted data mapping.
  • Understanding of model output validation, semantic mapping, entity extraction, and data classification.
  • Familiarity with GPU/TPU-accelerated computing environments, including monitoring, troubleshooting, and performance testing of associated data pipelines.
  • Exposure to NVIDIA GPU infrastructure, Google TPUs, or comparable AI computing environments is an asset.

Healthcare Data Standards & Medical Ontologies Working knowledge of healthcare data standards and medical terminology, including:

  • HL7 and FHIR
  • OMOP Common Data Model (OMOP CDM)
  • SNOMED CT
  • LOINC
  • ICD-10

Test Management & Development Tools

  • Experience with Jira and/or Azure DevOps for test management, requirements traceability, defect tracking, and reporting.
  • Familiarity with Git, CI/CD workflows, and automated test execution., * Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, Bioinformatics, Health Informatics, or a related technical discipline.

Benefits & conditions

Where required by law, NTT DATA provides a reasonable range of compensation for specific roles. The starting pay range for this remote role is $93,816-$131,500. This range reflects the minimum and maximum target compensation for the position across all US locations. Actual compensation will depend on a number of factors, including the candidate’s actual work location, relevant experience, technical skills, and other qualifications.

This position is eligible for company benefits including medical, dental, and vision insurance with an employer contribution, flexible spending or health savings account, life and AD&D insurance, short- and long-term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally-required benefits.

About the company

NTT DATA is a $30+ billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world’s leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. Our consulting and industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is part of NTT Group, which invests over $3 billion each year in R&D.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on careers-inc.nttdata.com
Prepare application

Good distractions

Loading talks and stories from around this role…