Senior Quality Engineer - Data Platform

MILLENNIUM
Dallas, TX, United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Airflow Amazon Web Services Automation of Tests Microsoft Azure Command-Line Interface Cloud Computing Configuration Management Code Generation
+40 more
Code Review Continuous Integration Data Validation Information Engineering Data Infrastructure Data Integrity Extract Transform Load (ETL) Data Mapping Data Warehousing Software Debugging DevOps Distributed Computing Environment Distributed Systems JSON Python (Programming Language) Modular Design Object-Oriented Software Development Query Optimization E2e Testing DataOps Data Streaming Test Data Web Application Frameworks Enterprise Data Management Data Logging Cloud Platform System Performance Testing Large Language Models Apache Spark AI Coding Agents Git Fastapi Pytest Containerization Pyspark Kubernetes Restful APIs Software Version Control Data Pipelines Data Generation

Job description

Senior Quality Engineer - Data Platform Mission Own comprehensive, risk-based validation of complex IRIS data-platform capabilities and provide actionable evidence of functional, data, integration, resiliency, and release quality, using production-quality Python automation, reusable validation frameworks, and automated CI/CD quality gates. Key responsibilities

  • Design, develop, test, and maintain production-quality Python test automation, applications, reusable components, and validation frameworks that support complex platform quality-engineering initiatives.

  • Design risk-based test strategies for complex features, integrations, data flows, and releases.
  • Build and maintain scalable automated suites for REST APIs, JSON contracts, ETL/ELT pipelines, transformations, orchestration workflows, Spark-based processing, Kubernetes-based services, and cloud dependencies.

  • Apply strong software-design practices, including object-oriented programming, modular design, parameterization, configuration management, structured logging, exception handling, packaging, and debugging, to Python automation frameworks and validation utilities.

  • Design complex data-reconciliation approaches that validate source-to-target completeness, accuracy, transformation logic, duplicates, null handling, referential integrity, and exception behavior.

  • Lead unit, regression, integration, end-to-end, negative, boundary, failure, recovery, resiliency, performance, and scalability validation for assigned capabilities.

  • Create reusable Python frameworks, validation libraries, templates, fixtures, controlled test data, and self-service capabilities that are adopted across workflows and teams.

  • Partner with data consumers, application teams, platform engineers, and software engineers to translate requirements and risks into validation approaches and improve the quality of delivered datasets.

  • Analyze complex application defects, pipeline failures, performance bottlenecks, and data-quality issues across application, data, orchestration, and environment layers; isolate failure conditions and provide actionable root- cause evidence.

  • Validate application and pipeline behavior across supported cloud and Kubernetes configurations, dependencies, scaling conditions, and recovery scenarios.

  • Implement and use observability, monitoring, logging, and alerting capabilities to validate data quality, application reliability, and timely pipeline execution across cross-component workflows.

  • Maintain traceability among requirements, risks, tests, defects, execution results, and release-quality evidence; identify systemic coverage gaps and drive remediation through test design, engineering improvements, or explicit risk acceptance.

  • Embed automated quality gates into CI/CD pipelines and drive cloud-native development, DevOps, and quality- engineering practices across applicable platform components.

  • Drive improvements in test automation, pipeline reliability, performance, and operational efficiency through reusable engineering patterns and continuous automation.

  • Review test designs and automation code, mentor Quality Engineers, and contribute technical documentation, knowledge sharing, and reusable implementation examples.

  • Use AI-assisted software and test development responsibly to accelerate Python coding, test generation, test- data creation, debugging, troubleshooting, and documentation while maintaining documented human review of all generated outputs for correctness, security, maintainability, relevance, and coverage. Expected deliverables

  • Risk-based feature and release test strategies.
  • Production-quality Python test automation, validation frameworks, and reusable components committed to source control.

  • Cross-component automated unit, functional, API, data, regression, integration, and end-to-end test suites.

  • Reusable Python frameworks, libraries, fixtures, templates, controlled test data, and self-service validation capabilities adopted across workflows.

  • Complex data-reconciliation, resiliency, and failure/recovery validation assets.
  • Defect evidence, root-cause analyses, and retest confirmation for complex cross-component issues.
  • Requirements-to-test traceability, quality-risk assessments, and release-readiness evidence.
  • Automated CI/CD quality gates, observability capabilities, and actionable diagnostic information.
  • Test reviews, mentoring outputs, coverage-improvement plans, technical documentation, and knowledge-transfer materials.

Requirements

  • Strong Python software-development and automated quality-engineering experience, including object-oriented programming, classes, modules, functions, parameters, exception handling, reusable component design, and pytest or comparable testing frameworks.

  • Proficiency with Python logging, configuration management, command-line parameters, debugging, structured error-handling patterns, dependency management, and Python packaging.

  • Experience writing unit, integration, regression, and end-to-end tests for Python applications, automation frameworks, reusable components, and transformation logic.

  • Knowledge of software-design principles, maintainable coding practices, source control, code reviews, reusable framework design, and automated quality gates.

  • Strong SQL development, query optimization, data validation, and data-reconciliation capabilities.
  • Experience with data engineering and the development and testing of ETL/ELT pipelines.
  • Strong hands-on experience with Apache Spark or PySpark and distributed data processing.
  • Experience using Python for data transformation, test automation, validation, and operational tooling.
  • Strong hands-on experience with Apache Airflow or comparable workflow-orchestration platforms.
  • Knowledge of data modeling, data warehousing, source-to-target mapping, and transformation concepts.
  • Strong REST API testing, JSON validation, data-pipeline testing, negative testing, boundary testing, and failure- recovery validation capabilities.

  • Strong hands-on experience validating containerized applications, data workloads, and services in Kubernetes- based environments.

  • Strong experience with cloud-native platforms and AWS services; experience with Azure is also beneficial.
  • Strong hands-on experience with Git, CI/CD, DevOps practices, automated quality gates, and deployment- validation processes.

  • Experience with observability, structured logging, monitoring, alerting, diagnostics, and operational analytics.
  • Knowledge of data quality, lineage, governance, traceability, and release-evidence practices.
  • Ability to create reproducible defects, isolate failure conditions, perform root-cause analysis, assess risk, and communicate actionable quality evidence.

  • Demonstrated commitment to automation, reusable engineering patterns, continuous improvement, and operational excellence.

  • Strong hands-on proficiency with data reconciliation, enterprise data-platform testing, resiliency testing, test- framework development, and root-cause analysis.

  • Demonstrated ability to lead validation of complex cross-component changes and guide other quality engineers.
  • Knowledge of AI-assisted software development, including the effective use of coding copilots and large language models to accelerate development, testing, test-data creation, documentation, debugging, and troubleshooting.

  • Demonstrated ability to review and validate AI-generated code, tests, documentation, and recommendations for correctness, security, maintainability, relevance, and coverage. Preferred qualifications

  • Experience with non-functional testing, distributed systems, production incident analysis, or data observability.
  • Experience creating testing frameworks or common enterprise QE assets.
  • Experience communicating release risk to senior technical and product stakeholders.
  • Experience working in Agile product teams and vendor-delivered engagements.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…