Databricks Architect Migration

Tixy Services LLC

Chicago, IL, United States

about 1 month ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

3 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Amazon Web Services Microsoft Azure Big Data Cloud Database Continuous Integration Data Architecture Information Engineering Data Governance Extract Transform Load (ETL) Data Migration Data Warehousing Apache Hadoop

+18 more

Python (Programming Language) Microsoft SQL Server Oracle (Applications) SQL Databases Teradata SQL Data Processing Google Cloud Snowflake Apache Spark Git Data Lakes Pyspark Data Management Cloud Migration Azure Synapse Analytics Data Pipelines Jenkins Databricks

Job description

We are seeking an experienced Databricks Architect with a strong background in data migration and cloud modernization. The ideal candidate will design, develop, and implement scalable data solutions on the Databricks Lakehouse platform while leading migration initiatives from legacy data platforms to Databricks., * Design and implement Databricks-based data architectures and ETL/ELT pipelines.

Lead end-to-end migration projects from legacy data warehouses or big data platforms to Databricks.
Develop data pipelines using PySpark, SQL, Delta Lake, and Databricks Workflows.
Optimize data processing, performance, scalability, and cost.
Collaborate with business stakeholders, architects, and engineering teams to deliver high-quality solutions.
Ensure data governance, security, and best practices using Unity Catalog and CI/CD processes.

Requirements

8+ years of experience in Data Engineering/Data Architecture.
3+ years of hands-on experience with Databricks.
Strong expertise in PySpark, Spark, SQL, Python, and Delta Lake.
Experience migrating platforms such as Hadoop, Snowflake, Oracle, SQL Server, Synapse, or Teradata to Databricks.
Experience with Azure Databricks (preferred), AWS, or Google Cloud Platform.
Knowledge of ETL tools, Git, Azure DevOps/Jenkins, and cloud data architecture.