Sr. Test Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+21 more
Job description
A leading consulting firm is seeking a Sr. Test Data Engineer for a 6+ month contract to hire role. This is a remote role, but the client is located in Chicago, IL. Duties: * Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions. * Perform end-to-end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems. * Develop and execute complex SQL queries for backend and data validation testing. * Test large-scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF). * Perform functional, integration, regression, system, and data quality testing across data pipelines and applications. * Validate batch processing, job scheduling, dependencies, and workflow execution using Control-M and Unix/Linux environments. * Identify, document, track, and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution. * Develop and maintain reusable test scripts and automation solutions where applicable. * Participate in Agile/Scrum activities including sprint planning, refinement, daily stand-ups, reviews, and retrospectives. * Support test execution, release validation, production readiness, and post-deployment verification while ensuring established quality standards are met. Requirements * 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing. * Strong hands-on SQL skills, including writing complex queries for source-to-target validation, reconciliation, and data quality testing. * Experience testing large-scale data platforms and ETL/ELT pipelines. * Hands-on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF). * Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive. * Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control-M. * Strong understanding of data quality concepts, data transformations, data mappings, and source-to-target validation. * Experience with defect management and test management processes within Agile/Scrum delivery environments. * Strong analytical, troubleshooting, communication, and collaboration skills. U.S. Medicare Experience preferred ETL Testing & Data Validation 6+ years SQL & Data Quality Testing 6+ years Databricks / Apache Spark / PySpark 5+ years Python & Test Automation 5+ years Azure Data Factory (ADF) 5+ years
Requirements
and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution. * Develop and maintain reusable test scripts and automation solutions where applicable. * Participate in Agile/Scrum activities including sprint planning, refinement, daily stand-ups, reviews, and retrospectives. * Support test execution, release validation, production readiness, and post-deployment verification while ensuring established quality standards are met. Requirements * 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing. * Strong hands-on SQL skills, including writing complex queries for source-to-target validation, reconciliation, and data quality testing. * Experience testing large-scale data platforms and ETL/ELT pipelines. * Hands-on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF). * Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive. * Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control-M. * Strong understanding of data quality concepts, data transformations, data mappings, and source-to-target validation. * Experience with defect management and test management processes within Agile/Scrum delivery environments. * Strong analytical, troubleshooting, communication, and collaboration skills. U.S. Medicare Experience preferred ETL Testing & Data Validation 6+ years SQL & Data Quality Testing 6+ years Databricks / Apache Spark / PySpark 5+ years Python & Test Automation 5+ years Azure Data Factory (ADF) 5+ years
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦