Databricks Expert

Vetted Consultant, LLC
United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$145,600.0 - $166,400.0
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Microsoft Azure Big Data Cloud Computing Continuous Integration Data Architecture Python (Programming Language) Performance Tuning DataOps SQL Databases Apache Spark Multi-Cloud
+4 more
Information Technology Production Code Data Pipelines Databricks

Job description

This isn’t a backfill. We’re launching an entirely new data division within a Fortune 500 organization, and we’re looking for an engineer who wants to shape it. You’ll have the resources of a global enterprise and the creative freedom of a startup - designing pipelines, architecture, and data products that will power critical business decisions for years to come. If you’ve ever wanted to build something that truly matters, at real scale, this is it.

What you’ll do

  • Design, build, and optimize production-grade data pipelines and architectures inside the Databricks Lakehouse Platform
  • Architect scalable pipelines using Medallion Architecture, CI/CD principles, and rigorous testing standards
  • Tackle advanced engineering challenges - ingesting and transforming complex data from diverse, high-volume sources
  • Own schema management, data observability, governance, and performance tuning end-to-end
  • Champion data quality, integrity, and security across every solution you ship

Requirements

Do you have experience in Spark?, * Bachelor’s degree in Computer Science, Engineering, Statistics, or a related quantitative field

  • Deep hands-on expertise with the Databricks Lakehouse Platform
  • Strong command of Apache Spark for large-scale data processing
  • Expert-level Python and SQL - you write clean, efficient, production-ready code
  • Cloud experience across Azure, AWS, or GCP in a multi-cloud context
  • Solid grasp of data architecture principles and a track record designing real-world solutions
  • Databricks Certified Data Engineer Associate or Professional certification a strong plus

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan Ā· WWC Europe 2026

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki Ā· WWC 2022

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy Ā· LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan Ā· WWC Europe 2026

1:41 min

Visualizing the complex developer journey for JVM ecosystems

Bobur Umurzokov Ā· LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy Ā· LIVE

Videos

See all

Related articles

See all