Sr. Databricks Developer

Robotics Technologies LLC
Columbus, OH, United States
6 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Big Data Data Architecture Information Engineering Extract Transform Load (ETL) Machine Learning Operational Databases Data Mesh Data Streaming Enterprise Data Management Data Processing Apache Spark
+7 more
Data Lakes Pyspark AWS Data Analytics Data Management Machine Learning Operations Data Pipelines Databricks

Job description

We are seeking an experienced Senior Databricks Developer with strong expertise in Databricks and AWS ecosystems, large-scale data engineering, and modern Lakehouse architecture. The ideal candidate should have hands-on experience building high-volume, production-grade ETL/ELT pipelines, streaming solutions, and scalable data platforms., * Design, develop, and maintain scalable data engineering solutions using Databricks and AWS.

  • Implement and optimize Delta Lake and Lakehouse architecture.
  • Develop high-performance ETL/ELT pipelines using PySpark and Scala Spark.
  • Build and manage high-volume, production-grade data processing workflows.
  • Implement real-time and streaming data pipelines using Databricks and Delta Live Tables (DLT).
  • Implement and support MLOps solutions within the Databricks ecosystem.
  • Apply Data Mesh architecture principles to enterprise data platforms.
  • Optimize data processing workloads for performance, scalability, and cost efficiency.
  • Monitor and troubleshoot production data pipelines to ensure reliability and data quality.
  • Collaborate with data engineering, architecture, and ML teams to deliver enterprise data solutions.

Requirements

  • Deep knowledge of Databricks and AWS ecosystems.
  • Strong experience with Delta Lake and Lakehouse Architecture.
  • Knowledge of Lakeflow and Lakebase.
  • Hands-on expertise in PySpark and Scala Spark.
  • High-volume production-grade Databricks ETL/ELT engineering.
  • Experience with Streaming and Delta Live Tables (DLT).
  • MLOps implementation and experience within Databricks.
  • Knowledge of Data Mesh architecture.
  • Advanced cost optimization and performance engineering.
  • Strong experience as a Databricks and AWS Data Engineer

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…