Databricks Engineer

Slalom, LLC
Atlanta, GA, United States
26 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$90,000.0 - $115,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Adobe InDesign Artificial Intelligence Airflow Big Data Cloud Database Code Coverage Computer Programming Information Engineering Data Systems Cursor (Graphical User Interface Elements) DevOps
+26 more
Distributed Computing Environment Python (Programming Language) NoSQL Object-Oriented Software Development Cloud Services SQL Stored Procedures SQL Databases Data Streaming YAML GitHub Copilot Snowflake Multi-Agent Systems Apache Spark Containerization Data Lakes Pyspark Infrastructure Automation Frameworks Collibra Google Bigquery Data Management Presto Terraform Data Pipelines Amazon Elastic Mapreduce (EMR) Amazon Redshift Databricks

Job description

  • Be a technical leader in teams with minimal oversight and direction to deliver innovative solutions on the Databricks Platform using core cloud data lakehouse methodologies, tools, distributed processing engines, event streaming platforms, and other modern data related technologies.
  • Be part of the Databricks Center of Excellence.
  • Build the next generation of data platforms and work with some of the most forward-thinking organizations in data and analytics.
  • Work under the direction of a Solution Architect to help design and implement components of our clients’ data platform solution.
  • Participate in design sessions and be able to break down complex development tasks, and complete development items on time.
  • Contribute to various COE initiatives to develop Databricks solution accelerators and bring an innovative mindset.

What You’ll Bring

As a consultant in the Databricks practice, you will bring a curious mindset and a passion for exploring innovative solutions to address our clients’ most pressing data challenges. You are a self-starter who excels at breaking down complex problems and eagerly shares insights with your team and the broader Builder community., * Develop and implement data solutions using Databricks, with hands-on experience in specific Databricks platform features such as Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative Pipelines), and Unity Catalog.

  • Collaborate with cross-functional teams to design and optimize data pipelines for both batch and streaming data, ensuring data quality and efficiency.
  • Stay updated with emerging technologies, latest Databricks platform features, and continuously improve your skills in Databricks and other relevant tools.

Requirements

  • 5+ years of data engineering experience, with at least 2 years of hands-on data pipeline design and development experience with Databricks, including specific -platform features like Delta Lake, Uniform (Iceberg), Delta Live Tables (Lakeflow Declarative pipelines), and Unity Catalog.
  • Proficiency in designing and building robust, scalable, YAML configuration driven data pipelines with batch, micro-batch, and streaming data ingestion and processing patterns using tools like Auto Loader demonstrating a strong understanding of modern data engineering practices.Experienced in building complex job/workflow orchestration patterns using either Databricks jobs/workflows or with other orchestration tools like Airflow, dbt etc.
  • Exposure in building robust data quality, pipeline audit/observability solutions with Databricks native features and/or other data quality tools/frameworks like Great Expectations, Collibra, dbt etc.
  • Proficiency in Big Data Platforms: Apache Spark, Presto, Amazon EMR
  • Experience with Cloud Data Warehouses: Amazon Redshift, Snowflake, Google BigQuery.
  • Strong programming skills using SQL, Stored Procedures and Object-Oriented Programming languages (like Java, Python, PySpark etc.).
  • Familiarity with building DevOPs, CI/CD pipelines using Databricks Asset Bundles with automated validation and testing.
  • Exposure with Infrastructure as Code (IaC) tools like Terraform is a big plus.
  • Familiarity with NoSQL Databases and Container Management Systems.
  • Experience with agentic AI tooling and frameworks and applying autonomous or semi-autonomous agents within data engineering, orchestration, analytics, or platform automation use cases.
  • Hands-on experience leveraging AI-powered coding assistants such as GitHub Copilot, Codex Claude Code, Cursor, Windsurf or similar tools to accelerate development, improve test coverage, enhance documentation, and drive engineering productivity in enterprise environments.
  • Interest in exploring AI-native development patterns and embedding intelligent automation into modern Lakehouse and cloud-native data architectures.
  • An ideal candidate will have Databricks Data Engineering Associate and/or Professional certification completed with multiple Databricks project delivery experiences.

Benefits & conditions

Slalom prides itself on helping team members thrive in their work and life. As a result, Slalom is proud to invest in benefits that includemeaningful time off and paid holidays, parental leave, 401(k) with a match, a range of choices for highly subsidized health, dental, & vision coverage, adoption and fertility assistance, and short/long-term disability. We also offer yearly $350 reimbursement account for any well-being-related expenses, as well as discounted home, auto, and pet insurance.

About the company

Slalom is a fiercely human business and technology consulting company that leads with outcomes to bring more value, in all ways, always. From strategy through delivery, our agile teams across 52 offices in 12 countries collaborate with clients to bring powerful customer experiences, innovative ways of working, and new products and services to life. We are trusted by leaders across the Global 1000, many successful enterprise and mid-market companies, and 500+ public sector organizations to improve operations, drive growth, and create value.

At Slalom, we believe that together, we can move faster, dream bigger, and build better tomorrows for all., Slalom is a fiercely human business and technology consulting company that leads with outcomes to bring more value, in all ways, always. From strategy through delivery, our agile teams across 52 offices in 12 countries collaborate with clients to bring powerful customer experiences, innovative ways of working, and new products and services to life. We are trusted by leaders across the Global 1000, many successful enterprise and mid-market companies, and 500+ public sector organizations to improve operations, drive growth, and create value. At Slalom, we believe that together, we can move faster, dream bigger, and build better tomorrows for all.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.jofdav.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

1:38 min

Managing and versioning system prompts as YAML files

Kevin Lewis Kevin Lewis +1 · WWC 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

1:31 min

Orchestrating generative configurations using standardized YAML files

Han Xiao · WWC 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all