ETL SDET Testing - NYC, NY

Lorven Technologies Inc

New York, NY, United States

about 2 months ago

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

careerjet.com

Tech stack

Agile Methodology Amazon Web Services Amazon S3 Automation of Tests Big Data Cloud Computing Databases Computer Engineering Data Validation Data Integration Extract Transform Load (ETL) Data Transformation

+15 more

Database Queries DevOps Metadata Repositories Standard Sql Software Testing Automation Framework Data Processing Scripting Cloud Platform System Data Build Tool (dbt) Data Lakes Pyspark Information Technology Amazon Simple Queue Service (SQS) Data Pipelines SDET

Job description

The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows. This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues. The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity., Title: ETL Developer Location: New York ( Hybrid 3 days onsite )- local candidates only. Duration: Contract for one year with possibility for extension. At least 5 years of e…

1 day ago, ETL Developer LOCATION: Brooklyn, NY Hybrid 3 days onsite Contract for one year with possibility for extension. At least 5 years of experience as ETL Developer. Develop compl…
1 day ago, With 10+ over all .At least 5 years of experience as ETL Developer. Develop complex data pipelines to bring data into the Data Lake/Warehouse per business requirements. Desi…
1 day ago +

Requirements

Bachelor’s degree preferably in Computer Science, Information technology, Computer Engineering, or related IT discipline or equivalent experience with 12+ Minimum Experience, * At least 12 years of IT experience with minimum 5 years of experience in below skills Tech Skills Proficiency in ETL Testing and developing automation framework &test cases in at least one scripting language.

Primary Skill : PySpark, ETL Testing, SQL
Strong SQL skills, with experience in handling big data using ETL tools (e.g. Informatica).
Mandatory work experience with PySparkTesting experience in cloud environment (AWS)S3, SSS, Glue, EMR, Data Catalog, Crawler, SQS, ETL Jobs, Event Bridge.
Athena, Redshift Spectrum Databases.
AWS Commands for running the jobs, file process and movements.
Experience with Test Automation and DevOps practices in ETL and Cloud Systems.
Experience with Test Automation and DevOps practices in ETL and Cloud Work experience in a Big Data ecosystem processing data in datalakehouse.
Familiarity with DBT (Data Build Tool) or similar data transformation tools is plus.

Experience providing testing oversight in Agile team. Should have excellent business communication to interact with Business teams and cross-functional teams