Software Engineer - ETL Developer (Ref# SEETLD94NN)

Job Duties: Design scalable, secure, and high-availability data solutions while ensuring data quality, governance, and performance optimization across large datasets. Responsible for data architecture, ETL/ELT pipelines, data warehousing, and cloud-based big data platforms. Provide solutions for Data Lakes, Data Warehouses, BI reporting, and dashboards. Involved in all stages of the software development life-cycle including requirement analysis, design, development, and implementation of the system. Perform design and code reviews and extensive documentation of ETL standards, best practices, and reporting procedures. Document process description defining and encapsulating the component interfaces. Perform Continuous Integration and Continuous Deployment (CI / CD) using knowledge of Jenkins, Jira, and AWS. Responsible for architecture design and development of data pipelines. Validate technical and data scripts with specialized iceDQ tools to improve performance. Design technical documents on the solution delivered as required. Work on building multidimensional model such as multiple data sources including data warehouses, data marts, operational databases, and departmental databases. Develop SQL queries to perform DDL / DML against the databases and perform unit and system testing. Develop test data and conduct performance testing on the developed modules. Ensure issues are identified, tracked, reported on, and resolved in a timely manner. Fine tune jobs/process for higher performances and debug critical/complex jobs. Participate in various teams, prepare reports, and analyze effective solutions for business partners. Build and maintain modular Snowflake data models with dbt. Orchestrate end-to-end ETL using Apache Airflow (DAGs with Snowflake operator / Python operator), ensuring idempotence, retries, SLAs, and observability. Manage Fivetran connectors for Snowflake ingestion, handle schema drift, validate data freshness, and integrate with dbt for end-to-end lineage. Use of Snowflake, Azure Data Factory (ADF), Azure Data Lake, Azure Blob Storage, Azure Databricks, Python, dbt, Apache Airflow, GitHub, Jenkins, SQL, MySQL, Oracle, and AWS.

Position requires 2 years of experience with Data Warehouses, Data Lakes, CI/CD, data pipelines, and Snowflake., Requirements: Master’s degree or foreign academic equivalent in Computer Science, Computer Engineering, Electrical/Electronics Engineering, Information Technology, Information Systems, or a related field. Plus 2 years of experience in the job offered or a related occupation including Systems Analyst, Data Consultant, or related experience. Will accept a Bachelor’s degree plus 5 years of progressive experience in lieu of the required education and experience. Position requires 2 years of experience with Data Warehouses, Data Lakes, CI/CD, data pipelines, and Snowflake. Will accept any suitable combination of education, training, or experience as per the requirements cited herein. 40hrs/week.