Sr. QA Automation Engineer- Enterprise Data & Analytics

Educology Solutions
Adelphi, United States of America
29 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Adelphi, United States of America

Tech stack

Artificial Intelligence
Data analysis
Audit Trail
Automation of Tests
Azure
Data Validation
Information Engineering
Data Governance
Data Integrity
Data Visualization
DevOps
Information Lifecycle Management
Python
Scaled Agile Framework
SQL Databases
Tableau
Test Data
Enterprise Data Management
Feature Engineering
PySpark
Data Lineage
Collibra
Data Management
SDET
Databricks

Job description

ESI is seeking a highly skilled and self-directed Senior QA Engineer/SDET to drive comprehensive quality engineering for our Enterprise Data & Analytics Platform. Reporting into the Sr. Director - Analysis, Change and Quality, this role will own and implement advanced automated testing strategies across the entire data lifecycle, ensuring data reliability, data quality, and AI/BI model accuracy. This role requires deep technical expertise in automation tools to test data pipelines in data bricks and data quality frameworks., * Architect and implement robust automated testing frameworks leveraging PySpark and Databricksnative tools for data validation across Raw, Curated, and Mart layers.

  • Design and implement data quality validation frameworks, including checks on accuracy, completeness, and consistency across transformation layers.
  • Create advanced data quality KPIs, integrating them into automated dashboards to track quality trends across layers.
  • Design metadatadriven tests, integrating with CI/CD pipelines, with coverage on all transformation layers.
  • Lead development of QA user stories and acceptance criteria, precisely defining test scenarios for ingestion, transformation, and consumption layers.
  • Perform complex data reconciliation testing across 10+ source systems, ensuring accuracy, completeness, and consistency from source through Mart.
  • Own the endtoend testing lifecycle (QA, Staging, Production), defining what and when to test at each stage and ensuring signoff criteria are met.
  • Partner closely with data engineers to troubleshoot pipeline failures, connectivity issues, and performance bottlenecks.
  • Set standards for data lineage and auditability, ensuring every transformation step can be validated and traced.
  • Plan, facilitate, and manage User Acceptance Testing (UAT) involving business users for data visualization tools such as Tableau running on Databricks.
  • Prepare UAT test scenarios aligned with business use cases, guide users through testing, and gather actionable feedback.
  • Drive defect triage, resolution, and retesting, ensuring readiness for production release.
  • Work within a SAFe Agile framework, participating in PI planning, sprint ceremonies, and crossteam coordination. Collaborate with DevOps, Data Engineers, Data Scientists, and Product Owners to integrate QA into CI/CD pipelines.
  • Provide regular updates to project and senior management on progress of QA milestones and tasks., Employees first. Customer always. Mission driven. Everyone matters. Join the vibrant team at ESI where we prioritize our employees' well-being and champion customer satisfaction above all else. Our culture is defined by a mission-driven approach, ensuring that every member contributes to our collective success. At ESI, we value the unique perspectives each individual brings to the table. Through collaboration and innovation, we're reshaping the digital landscape of public sector services. If you're passionate about making a difference, eager to grow professionally, and thrive in a supportive environment, join us in our journey to create impactful solutions and drive positive change.

Requirements

Do you have experience in Tooling?, * Minimum of 5+ years of solid experience in Data Engineering with proven experience testing and validating data pipelines in Databricks, including medallion architecture.

  • Proficient in creating testing framework for validating Data Quality.
  • Proficient in Databricks notebook, PySpark, Python, SQL, and data quality testing.
  • Expert with testing AI/BI models, ensuring data quality from feature engineering through model scoring.
  • Experience in CI/CD pipelines (e.g., Azure DevOps) for automated test execution.
  • Strong knowledge of data governance (data lineage, audit trails, compliance testing).
  • Excellent problemsolving skills with the ability to work in a fastpaced environment.
  • Experience with tools such as Azure Purview and Profisee MDM is preferred.

Apply for this position