Ab Initio Migration Specialist
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+5 more
Job description
We are seeking an experienced Ab Initio expert to lead and support the migration of legacy Ab Initio workloads to Azure Databricks. The candidate will serve as the onshore technical subject matter expert, bridging business stakeholders and offshore delivery teams while ensuring data accuracy and delivery quality throughout the migration. Scope of Engagement Act as the key Ab Initio SME for the migration of Ab Initio graphs and plans to Azure Databricks ETL jobs, covering assessment, conversion, validation, and cutover. Translate Ab Initio logic into Databricks (Spark/PySpark/SQL) equivalents. Act as the onshore SME, partnering with business teams and translating requirements into clear specs for offshore delivery. Provide guidance, knowledge transfer, and data debugging support to offshore engineers. Support data validation during migration and help resolve source-side Ab Initio ETL execution issues. Flexible working hours to ensure effective overlap with offshore teams across time zones., Analyze and interpret existing Ab Initio graphs, plans, and components to document business and transformation logic. Translate complex Ab Initio functions (transform, rollup, join, partition/departition, lookup, normalize/denormalize, etc.) into target Databricks ETL designs. Partner with business teams to capture requirements and translate them into actionable specifications for offshore development teams. Provide technical guidance and knowledge transfer to offshore engineers executing the conversion. Lead data debugging, reconciliation, and root-cause analysis to resolve discrepancies between source (Ab Initio) and target (Databricks) outputs. Support data validation and reconciliation throughout the migration to ensure source-to target parity. Troubleshoot and resolve source-side Ab Initio ETL execution issues to keep migration and validation on track. Define reusable conversion patterns, templates, and best practices to accelerate delivery. Support SIT/UAT cycles, validate data parity, and assist with performance tuning on Databricks., Education Degree(s) Must Have Bachelorâs Degree, University/ Month / Year: Last 4 Digits of SS#: Month & Day (not year) of Birth: LinkedIn Profile: Reason for Looking: References (Please provide 2 or 3 if possible): Any Offer or Interviews in Pipeline? Willing to Relocate? Willing to Work Onsite or Hybrid: Availability for F2F Interview: Yes/No: Availability to Start: Asking Pay Rate (Hourly): Skill/Experience: Self-Rank 1-5 (5=Expert) # Yearsâ Experience Ab Initio (GDE, EME, Co>Op, Conduct>It) Azure Databricks (Spark/PySpark/SQL) ETL Migration & Modernization Data Validation & Debugging Azure Data Services (ADLS, ADF, Azure SQL) CI/CD for Data Pipelines Stakeholder & Offshore Team Collaboration Any Certifications? (Please List)
Requirements
Strong hands-on expertise with Ab Initio (GDE, Co>Operating System, EME, Conduct>It plans, Continuous Flows). Deep understanding of Ab Initio graph design, components, and DML/transform functions. Working knowledge of Azure Databricks, Apache Spark, PySpark, and SQL. Proven experience in legacy ETL modernization or migration programs. Strong data analysis, validation, and debugging skills with the ability to trace logic across complex pipelines. Excellent communication skills to work across business stakeholders and distributed offshore teams. Preferred Qualifications Overall 5 to 10 years of experience. Experience migrating Ab Initio (or comparable legacy ETL such as Informatica/Teradata) to Databricks or other cloud lakehouse platforms. Familiarity with Azure data services (ADLS, ADF, Azure SQL) and CI/CD for data pipelines. Domain exposure to healthcare, banking, or other regulated, data-intensive industries. Experience leading or mentoring offshore delivery teams. Engagement Details Onshore role with regular interaction across onshore and offshore teams. Flexible working hours to maintain effective overlap with offshore time zones. Skill Matrix details
Benefits & conditions
BUGENDAITECH US LLC
-
Scottsdale, AZ Benefits: Competitive salary Dental insurance Flexible schedule Health insurance Opportunity for advancement Paid time off Training & development Vision insurance WellnesâŚ
-
8 days ago + *
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role â technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How We Built a Worry-Free System That Runs for 10+ Years â And What Weâd Do Again
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
How to Become an AI Engineer
Navigating the AI Shift