Databricks Architect

ValueMomentum, Inc.
Boon Township, United States of America
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Boon Township, United States of America

Tech stack

Unity
Amazon Web Services (AWS)
Cloud Engineering
Databases
Continuous Integration
Information Engineering
Data Infrastructure
ETL
Data Warehousing
DevOps
Hive
Oracle Applications
Performance Tuning
DataOps
PL-SQL
SQL Databases
Data Streaming
Data Processing
Data Lake
PySpark
Data Management
Machine Learning Operations
Software Coding
Data Pipelines
Databricks

Job description

We are looking for a highly senior, deeply hands on Databricks Architect to lead a large-scale Oracle-to-Databricks migration, covering schema migration, code conversion, and ODI job modernization. The ideal candidate has extensive experience building enterprise-grade data platforms on Databricks, has executed at least one greenfield Databricks implementation, and is exceptionally strong in PySpark, Spark SQL, framework development, and Databricks Workflows., * Lead the full Oracle ? Databricks migration including schema translation, ETL/ELT logic modernization, and ODI job replacement.

  • Develop reusable PySpark frameworks, data processing patterns, and orchestration using Databricks Workflows.
  • Build scalable, secure, and cost-optimized Databricks infrastructure and data pipelines.
  • Collaborate with business and technical stakeholders to drive data modernization strategy.
  • Establish development best practices, coding standards, CI/CD, and DevOps/DataOps patterns.
  • Provide technical mentorship and create training plans for engineering teams.
  • Contribute to building MLOps and advanced operations frameworks.

Requirements

  • 14+ years in Data Engineering/Architecture with at least 4+ years hands-on Databricks experience delivering end-to-end cloud data solutions.
  • Strong experience migrating from Oracle/on-prem systems to Databricks, including SQL, PL/SQL, ETL logic, and ODI pipelines.

Deep hands-on expertise in:

  • PySpark, Spark SQL, Delta Lake, Unity Catalog
  • Designing high-performance batch and streaming pipelines
  • Proven experience with greenfield Databricks implementations.
  • Strong understanding of cloud-native architectures on AWS and modern data platform concepts.
  • Solid knowledge of data warehousing, columnar databases, and performance optimization.
  • Good understanding of Agile/Scrum development processes.
  • Good Understanding of Golde Gate.

Apply for this position