DataFlux Architect/Developer

ICS Global Soft INC

Irving, United States

10 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Airflow Amazon Web Services Microsoft Azure Data Architecture Data Deduplication Data Governance Data Integration Data Warehousing Apache Hive Meta-Data Management Role-Based Access Control Reference Data

+7 more

SAS (Software) Google Cloud Data Lakes Pyspark DataFlux Data Management Databricks

Job description

Our client is undertaking a strategic modernization initiative to migrate their enterprise data quality, MDM, and data integration workloads from SAS DataFlux DFPower Studio Data Management Studio and the DataFlux Data Management Server to the Databricks Lakehouse Platform We are seeking a Senior Onshore DataFlux Solution Architect to lead the architectural strategy target state design and migration blueprint for this multi-phase program, * Lead end to end solution architecture for the DataFlux to Databricks migration including current state

assessment gap analysis target state design and migration roadmap
Partner with the client 39s enterprise architecture data governance and security teams to align on Unity
Catalog design lineage RBAC and PII handling
Provide technical leadership and mentorship to a blended onshore offshore engineering team conduct design
reviews and enforce engineering standards
DataFlux Expertise Non-Negotiable

Requirements

10 years of enterprise data architecture experience with a minimum of 5 years of hands on experience

designing and deploying solutions on SAS DataFlux DFPower Studio and/or Data Management Studio).

Master Data Management MDM

Strong architectural experience across MDM domains Customer/Party Product Location Vendor

Employee and Reference Data

Databricks amp Modern Data Stack

Production experience architecting solutions on Databricks including Delta Lake Unity Catalog Delta Live

Tables Workflows and the medallion architecture pattern

Strong PySpark and Spark SQL skills able to design performant patterns for large scale matching deduplication and DQ workloads

Working knowledge of cloud platforms Azure AWS or Google Cloud Platform and modern ingestion tools Fivetran ADF, Airflow dbt Data Domains amp Governance

Broad fluency across data quality data governance data modeling 3NF dimensional Data Vault and metadata management.

Preferred Qualifications

Prior experience leading at least one DataFlux modernization or sunset program
Databricks certifications Data Engineer Professional Solutions Architect Professional
Experience in healthcare payer financial services or insurance verticals