SDET (ETL Testing | AWS | PySpark )

The role involves ensuring the quality and reliability of ETL processes and data integration workflows by developing automated test frameworks, validating data transformations and migrations, and identifying data quality issues across cloud-based data pipelines., * Review business requirements, technical specifications, and design documents.

• Develop and implement test strategies for complex data initiatives.
• Design, develop, and execute automated test scripts and frameworks.
• Validate ETL processes, data transformations, data migrations, and data quality.
• Plan, estimate, and coordinate testing activities.
• Identify, document, track, and troubleshoot defects.
• Perform regression testing and root cause analysis.
• Collaborate with data engineers, developers, business teams, and cross-functional stakeholders.
• Ensure testing processes meet quality standards and business requirements.

• Strong experience in ETL testing and test automation framework development.
• Mandatory hands-on experience with PySpark.
• Strong SQL skills and experience with big data processing tools such as Informatica.
• AWS cloud testing experience, including S3, Glue, EMR, Data Catalog, Crawlers, SQS, EventBridge, and ETL jobs.
• Experience with Athena and Redshift Spectrum.
• Knowledge of AWS CLI commands for job execution, file processing, and file movement.
• Experience with data lakes or lakehouse architectures.
• Familiarity with DBT or similar data transformation tools is an added advantage.
• Experience with test automation, DevOps practices, and Agile methodologies., * Minimum 8 years of overall IT experience.
• At least 5 years of relevant experience in ETL testing, automation, and data technologies.
• Mandatory PySpark experience.
• Strong SQL, AWS, and big data testing knowledge.
• Excellent communication and problem-solving skills. *