Ab Initio Migration Specialist

Vista Applied Solutions Group Inc
Phoenix, AZ, United States
about 2 months ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
1 year minimum
Working hours
Shift work

Tech stack

Data Analysis Continuous Integration Data Validation Extract Transform Load (ETL) Data Manipulation Languages Software Debugging SQL Azure Performance Tuning SQL Databases Teradata SQL Azure Data Factory Rollup
+5 more
Apache Spark Ab Initio Pyspark Data Pipelines Databricks

Job description

We are seeking an experienced Ab Initio expert to lead and support the migration of legacy Ab Initio workloads to Azure Databricks. The candidate will serve as the onshore technical subject matter expert, bridging business stakeholders and offshore delivery teams while ensuring data accuracy and delivery quality throughout the migration. Scope of Engagement Act as the key Ab Initio SME for the migration of Ab Initio graphs and plans to Azure Databricks ETL jobs, covering assessment, conversion, validation, and cutover. Translate Ab Initio logic into Databricks (Spark/PySpark/SQL) equivalents. Act as the onshore SME, partnering with business teams and translating requirements into clear specs for offshore delivery. Provide guidance, knowledge transfer, and data debugging support to offshore engineers. Support data validation during migration and help resolve source-side Ab Initio ETL execution issues. Flexible working hours to ensure effective overlap with offshore teams across time zones., Analyze and interpret existing Ab Initio graphs, plans, and components to document business and transformation logic. Translate complex Ab Initio functions (transform, rollup, join, partition/departition, lookup, normalize/denormalize, etc.) into target Databricks ETL designs. Partner with business teams to capture requirements and translate them into actionable specifications for offshore development teams. Provide technical guidance and knowledge transfer to offshore engineers executing the conversion. Lead data debugging, reconciliation, and root-cause analysis to resolve discrepancies between source (Ab Initio) and target (Databricks) outputs. Support data validation and reconciliation throughout the migration to ensure source-to target parity. Troubleshoot and resolve source-side Ab Initio ETL execution issues to keep migration and validation on track. Define reusable conversion patterns, templates, and best practices to accelerate delivery. Support SIT/UAT cycles, validate data parity, and assist with performance tuning on Databricks., Education Degree(s) Must Have Bachelor’s Degree, University/ Month / Year: Last 4 Digits of SS#: Month & Day (not year) of Birth: LinkedIn Profile: Reason for Looking: References (Please provide 2 or 3 if possible): Any Offer or Interviews in Pipeline? Willing to Relocate? Willing to Work Onsite or Hybrid: Availability for F2F Interview: Yes/No: Availability to Start: Asking Pay Rate (Hourly): Skill/Experience: Self-Rank 1-5 (5=Expert) # Years’ Experience Ab Initio (GDE, EME, Co>Op, Conduct>It) Azure Databricks (Spark/PySpark/SQL) ETL Migration & Modernization Data Validation & Debugging Azure Data Services (ADLS, ADF, Azure SQL) CI/CD for Data Pipelines Stakeholder & Offshore Team Collaboration Any Certifications? (Please List)

Requirements

Strong hands-on expertise with Ab Initio (GDE, Co>Operating System, EME, Conduct>It plans, Continuous Flows). Deep understanding of Ab Initio graph design, components, and DML/transform functions. Working knowledge of Azure Databricks, Apache Spark, PySpark, and SQL. Proven experience in legacy ETL modernization or migration programs. Strong data analysis, validation, and debugging skills with the ability to trace logic across complex pipelines. Excellent communication skills to work across business stakeholders and distributed offshore teams. Preferred Qualifications Overall 5 to 10 years of experience. Experience migrating Ab Initio (or comparable legacy ETL such as Informatica/Teradata) to Databricks or other cloud lakehouse platforms. Familiarity with Azure data services (ADLS, ADF, Azure SQL) and CI/CD for data pipelines. Domain exposure to healthcare, banking, or other regulated, data-intensive industries. Experience leading or mentoring offshore delivery teams. Engagement Details Onshore role with regular interaction across onshore and offshore teams. Flexible working hours to maintain effective overlap with offshore time zones. Skill Matrix details

Benefits & conditions

BUGENDAITECH US LLC

  • Scottsdale, AZ Benefits: Competitive salary Dental insurance Flexible schedule Health insurance Opportunity for advancement Paid time off Training & development Vision insurance Wellnes…

  • 8 days ago + *

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:33 min

Handling complete production optimizations with modern build tools

JS Congress

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy ¡ LIVE

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo ¡ LIVE

1:22 min

Understanding tree shaking concepts in modern bundlers

Stephen Cooper Stephen Cooper ¡ World Congress 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou ¡ Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph ¡ LIVE

Videos

See all

Related articles

See all