Sr SDET Data & Platform Quality

Select Minds LLC
Dallas, TX, United States
11 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon S3 Computing Platforms Automation of Tests Cloud Database Continuous Integration Data Architecture Data Validation Data Infrastructure Extract Transform Load (ETL) Software Debugging Distributed Data Store
+17 more
Distributed Systems Protocol Buffers JSON Python (Programming Language) Cloud Services Selenium Data Streaming Strategies of Testing Data Logging Backend Event Driven Architecture Avro AWS Data Analytics Real Time Data Apache Kafka Data Management SDET

Job description

We are seeking a Senior SDET to own automation quality for large-scale, data-heavy, event-driven platforms. This role focuses on backend, Kafka, and AWS data platform validation using Python-based automation frameworks.

This is a hands-on engineering role, not a traditional QA position.

  • No manual testing
  • No UI / Selenium-only testing
  • No basic ETL script validation

You will design and own automation frameworks that validate Kafka-driven architectures, backend services, and cloud-native data pipelines, while partnering closely with data and platform engineers., Automation & Framework Ownership

  • Design, build, and maintain Python-based test automation frameworks, not just individual test cases
  • Define reusable test libraries for validating data platforms and distributed systems
  • Drive automation standards, patterns, and best practices across teams

Kafka & Event-Driven Systems Testing

  • Validate Kafka-based event streams, including:
  • Topic-level data validation
  • Producer and consumer behavior
  • Message schemas, payload integrity, ordering, and replay scenarios
  • Failure handling, retries, and dead-letter scenarios
  • Test asynchronous workflows and event propagation across services

Data Platform & Backend Validation

  • Validate end-to-end data flows across distributed services and pipelines
  • Test backend APIs, service integrations, and asynchronous processing layers
  • Perform schema validation, transformation checks, data consistency, and completeness validation

AWS & Cloud Data Testing

  • Test cloud-native data platforms built on AWS services such as:
  • S3, Glue, Redshift, Lambda (or similar services)
  • Validate ingestion, processing, storage, and downstream consumption of data
  • Debug data and automation failures across multiple cloud services

CI/CD & Quality Gates

  • Embed automation into CI/CD pipelines
  • Enforce quality gates and fail pipelines on critical data or platform issues
  • Provide actionable feedback to engineering teams based on automation results

Collaboration & Strategy

  • Work closely with data engineers, platform engineers, and architects
  • Define test strategies for event-driven and distributed data systems
  • Proactively identify quality risks and gaps in platform design

Requirements

  • Strong test automation engineering experience using Python
  • Hands-on Kafka testing experience (real production systems, not theoretical knowledge)
  • Proven experience testing distributed and event-driven systems
  • Solid understanding of data validation concepts, including:
  • Schemas and contracts
  • Transformations and enrichment
  • Data consistency, completeness, and accuracy
  • Experience working in AWS-based data platforms
  • Ability to debug and troubleshoot issues across multiple services, not just log defects
  • Engineering mindset with ownership mentality

Nice to Have

  • Experience with schema registries (Avro / JSON / Protobuf)
  • Knowledge of streaming vs batch data architectures
  • Familiarity with observability, logging, and monitoring in distributed systems
  • Experience working in high-volume, near-real-time data environments

Flexible work from home options available.

Benefits & conditions

  • Competitive compensation
  • Hybrid
  • Opportunity for advancement

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…