Looking for Senior Data Migration Engineer || Dallas, TX (Remote)

Technogen, Inc.
Dallas, TX, United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Automation of Tests Unit Testing Big Data Code Review Directed Acyclic Graph (Directed Graphs) Extract Transform Load (ETL) Data Migration Data Warehousing Database Connection Python (Programming Language) Microsoft SQL Server
+11 more
Oracle (Applications) Oracle Warehouse Builder Performance Tuning Runbook SQL Databases SQLAlchemy Data Processing Macros Informatica Powercenter Parallel Computation Gitlab-ci

Job description

The Senior Data Migration Engineer serves as a hands-on technical contributor and delivery anchor, responsible for designing and implementing Python-based extract/load pipelines, dbt-based transformations, and Airflow-based orchestration for a large-scale migration from Informatica PowerCenter to a modern data stack. o This role requires deep expertise in converting complex Informatica workflows into Python, dbt, and Airflow, and the ability to deliver production-quality, functionally equivalent output at enterprise scale. Key Responsibilities

Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.

Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.

Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.

Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.

Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.

Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.

Perform peer code reviews and provide constructive technical feedback to fellow engineers.

Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.

Contribute to technical documentation, runbooks, and handover materials.

Key Responsibilities

Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.

Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.

Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.

Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.

Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.

Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.

Perform peer code reviews and provide constructive technical feedback to fellow engineers.

Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.

Contribute to technical documentation, runbooks, and handover materials.

Requirements

5+ years of Informatica PowerCenter experience - mappings, sessions, workflows, and parameterization

3+ years of hands-on dbt Core experience - model layering, macros, tests, incremental materializations

Any number of years of Airflow experience - DAG authoring, task dependencies, and incorporation with scheduling tool

5+ years of Python experience, including production use of parallelism and batch data processing

5+ years of SQL experience - complex joins, window functions, aggregations across large datasets

Experience with Oracle Data Pump (expdp/impdp) or SQL Server BCP / BULK INSERT for high-volume data movement

Preferred

Experience with SQLAlchemy, cx_Oracle, or pyodbc for Python-based database connectivity

Experience mentoring junior and mid-level engineers in offshore delivery models

About the company

TECHNOGEN, Inc. is a Proven Leader in providing full IT Services, Software Development and Solutions for 15 years.

TECHNOGEN is a Small & Woman Owned Minority Business with GSA Advantage Certification. We have offices in VA; MD & Offshore development centers in India. We have successfully executed 100+ projects for clients ranging from small business and non-profits to Fortune 50 companies and federal, state and local agencies.

Hi,

Greetings of the day!

We are looking to Hire a Talented Professional for the below Job opportunity with one of our clients

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…