Sr. Test Data Engineer

Login Consulting Services Inc.
Chicago, IL, United States
2 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Automation of Tests Batch Processing Big Data Software Bug Management Software Quality Data Validation Data Integration Extract Transform Load (ETL) Data Transformation Database Queries Apache Hadoop Hadoop Distributed File System
+21 more
Apache Hive Job Scheduling Python (Programming Language) Scrum Methodology Regression Testing Standard Sql SQL Databases Test Data Test Execution Engine Test Management Enterprise Data Management Freeform SQL Azure Data Factory Apache Spark Test Scripts Backend Pyspark Integration Tests Data Pipelines Databricks Control M

Job description

A leading consulting firm is seeking a Sr. Test Data Engineer for a 6+ month contract to hire role. This is a remote role, but the client is located in Chicago, IL. Duties: * Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions. * Perform end-to-end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems. * Develop and execute complex SQL queries for backend and data validation testing. * Test large-scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF). * Perform functional, integration, regression, system, and data quality testing across data pipelines and applications. * Validate batch processing, job scheduling, dependencies, and workflow execution using Control-M and Unix/Linux environments. * Identify, document, track, and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution. * Develop and maintain reusable test scripts and automation solutions where applicable. * Participate in Agile/Scrum activities including sprint planning, refinement, daily stand-ups, reviews, and retrospectives. * Support test execution, release validation, production readiness, and post-deployment verification while ensuring established quality standards are met. Requirements * 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing. * Strong hands-on SQL skills, including writing complex queries for source-to-target validation, reconciliation, and data quality testing. * Experience testing large-scale data platforms and ETL/ELT pipelines. * Hands-on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF). * Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive. * Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control-M. * Strong understanding of data quality concepts, data transformations, data mappings, and source-to-target validation. * Experience with defect management and test management processes within Agile/Scrum delivery environments. * Strong analytical, troubleshooting, communication, and collaboration skills. U.S. Medicare Experience preferred ETL Testing & Data Validation 6+ years SQL & Data Quality Testing 6+ years Databricks / Apache Spark / PySpark 5+ years Python & Test Automation 5+ years Azure Data Factory (ADF) 5+ years

Requirements

and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution. * Develop and maintain reusable test scripts and automation solutions where applicable. * Participate in Agile/Scrum activities including sprint planning, refinement, daily stand-ups, reviews, and retrospectives. * Support test execution, release validation, production readiness, and post-deployment verification while ensuring established quality standards are met. Requirements * 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing. * Strong hands-on SQL skills, including writing complex queries for source-to-target validation, reconciliation, and data quality testing. * Experience testing large-scale data platforms and ETL/ELT pipelines. * Hands-on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF). * Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive. * Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control-M. * Strong understanding of data quality concepts, data transformations, data mappings, and source-to-target validation. * Experience with defect management and test management processes within Agile/Scrum delivery environments. * Strong analytical, troubleshooting, communication, and collaboration skills. U.S. Medicare Experience preferred ETL Testing & Data Validation 6+ years SQL & Data Quality Testing 6+ years Databricks / Apache Spark / PySpark 5+ years Python & Test Automation 5+ years Azure Data Factory (ADF) 5+ years

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…