Sr SDET Data & Platform Quality

Select Minds LLC
Dallas, TX, United States
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Amazon S3 Computing Platforms Automation of Tests Cloud Database Continuous Integration Data Architecture Data Validation Data Infrastructure Extract Transform Load (ETL) Software Debugging Distributed Data Store
+17 more
Distributed Systems Protocol Buffers JSON Python (Programming Language) Cloud Services Selenium Data Streaming Strategies of Testing Data Logging Backend Event Driven Architecture Avro AWS Data Analytics Real Time Data Apache Kafka Data Management SDET

Job description

Role Overview We are seeking a Senior SDET to own automation quality for large-scale, data-heavy, event-driven platforms. This role focuses on backend, Kafka, and AWS data platform validation using Python-based automation frameworks. This is a hands-on engineering role, not a traditional QA position.

  • No manual testing * No UI / Selenium-only testing * No basic ETL script validation You will design and own automation frameworks that validate Kafka-driven architectures, backend services, and cloud-native data pipelines, while partnering closely with data and platform engineers. Key Responsibilities Automation & Framework Ownership * Design, build, and maintain Python-based test automation frameworks, not just individual test cases * Define reusable test libraries for validating data platforms and distributed systems * Drive automation standards, patterns, and best practices across teams Kafka & Event-Driven Systems Testing * Validate Kafka-based event streams, including: * Topic-level data validation * Producer and consumer behavior * Message schemas, payload integrity, ordering, and replay scenarios * Failure handling, retries, and dead-letter scenarios * Test asynchronous workflows and event propagation across services Data Platform & Backend Validation * Validate end-to-end data flows across distributed services and pipelines * Test backend APIs, service integrations, and asynchronous processing layers * Perform schema validation, transformation checks, data consistency, and completeness validation AWS & Cloud Data Testing * Test cloud-native data platforms built on AWS services such as: * S3, Glue, Redshift, Lambda (or similar services) * Validate ingestion, processing, storage, and downstream consumption of data * Debug data and automation failures across multiple cloud services CI/CD & Quality Gates * Embed automation into CI/CD pipelines * Enforce quality gates and fail pipelines on critical data or platform issues * Provide actionable feedback to engineering teams based on automation results Collaboration & Strategy * Work closely with data engineers, platform engineers, and architects * Define test strategies for event-driven and distributed data systems * Proactively identify quality risks and gaps in platform design

Requirements

Required Experience (Non-Negotiable) * Strong test automation engineering experience using Python * Hands-on Kafka testing experience (real production systems, not theoretical knowledge) * Proven experience testing distributed and event-driven systems * Solid understanding of data validation concepts, including: * Schemas and contracts * Transformations and enrichment * Data consistency, completeness, and accuracy * Experience working in AWS-based data platforms * Ability to debug and troubleshoot issues across multiple services, not just log defects * Engineering mindset with ownership mentality Nice to Have * Experience with schema registries (Avro / JSON / Protobuf) * Knowledge of streaming vs batch data architectures * Familiarity with observability, logging, and monitoring in distributed systems * Experience working in high-volume, near-real-time data environments Flexible work from home options available.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.wayup.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · World Congress 2024

3:02 min

Audience Q&A on data formats and engine tradeoffs

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

1:52 min

Customizing block storage tiers and formats

Ricardo Sueiras Sueiras · LIVE

2:03 min

Distinguishing type definition constructs from data validation routines

Clemens Vasters Clemens Vasters · World Congress 2025

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all