Sr. Data Engineer - Databricks

Smart It Staffing, Inc.
United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source

Tech stack

Unity 3d Amazon Web Services Microsoft Azure Big Data Cloud Computing Data Architecture Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Data Systems Decision Support Systems
+7 more
Performance Tuning Cloud Services Apache Spark Data Lakes Data Management Data Pipelines Databricks

Job description

As a Sr. Data Engineer - Databricks, you are responsible for designing, building, and maintaining scalable data solutions that enable analytics, reporting, and data-driven decision making across the organization. You bring deep experience working with modern data platforms and enjoy transforming complex data into reliable, high-quality datasets. You thrive in collaborative environments, partnering with analytics, engineering, and business teams to deliver impactful data pipelines. You are comfortable working in cloud-based ecosystems and consistently apply best practices in data engineering, data governance, and performance optimization. You take ownership of data solutions from design through deployment and ongoing optimization., * Design, develop, and maintain robust and scalable data pipelines using Apache Spark and cloud-native data services.

  • Build, optimize, and support ETL/ELT workflows to enable analytics, reporting, and downstream applications.
  • Implement and manage data solutions using Databricks, Delta Lake, and Unity Catalog.
  • Ensure data quality, reliability, and performance across large-scale and complex datasets.
  • Collaborate with cross-functional teams to gather data requirements and translate them into effective technical solutions.
  • Apply data engineering best practices related to scalability, security, monitoring, and maintainability.
  • Support the continuous improvement of data architecture, pipeline performance, and operational stability in a cloud environment.

Requirements

Do you have experience in Spark?, * 7+ years of experience in data engineering or a related technical role.

  • Strong hands-on experience with Databricks and Apache Spark are required.
  • Experience working with Delta Lake and Unity Catalog for data management and governance.
  • Solid understanding of data pipeline design, ETL/ELT patterns, and data modeling concepts.
  • Experience working with cloud data platforms such as Azure, AWS, or GCP.
  • Proven ability to design scalable, reliable, and high-performing data solutions.
  • Strong problem-solving skills and the ability to work effectively in collaborative, fast-paced environments.

About the company

Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Sr. Data Engineer - Databricks to join our innovative and dynamic team.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

2:36 min

Development tools for spatial computing and drones

Zaid Zaim Zaid Zaim · WWC 2023

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

Videos

See all

Related articles

See all