> Markdown version of [/jobs/ext/227329-sr-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/227329-sr-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Data Engineer - Databricks - **Company:** Smart It Staffing, Inc. - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Unity 3d, Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Decision Support Systems, Performance Tuning, Cloud Services, Apache Spark, Data Lakes, Data Management, Data Pipelines, Databricks - **Published:** May 14, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=c0ecb624db6893fb ## About the Role Do you have experience in Spark?, * 7+ years of experience in data engineering or a related technical role. * Strong hands-on experience with Databricks and Apache Spark are required. * Experience working with Delta Lake and Unity Catalog for data management and governance. * Solid understanding of data pipeline design, ETL/ELT patterns, and data modeling concepts. * Experience working with cloud data platforms such as Azure, AWS, or GCP. * Proven ability to design scalable, reliable, and high-performing data solutions. * Strong problem-solving skills and the ability to work effectively in collaborative, fast-paced environments. ## Description As a Sr. Data Engineer - Databricks, you are responsible for designing, building, and maintaining scalable data solutions that enable analytics, reporting, and data-driven decision making across the organization. You bring deep experience working with modern data platforms and enjoy transforming complex data into reliable, high-quality datasets. You thrive in collaborative environments, partnering with analytics, engineering, and business teams to deliver impactful data pipelines. You are comfortable working in cloud-based ecosystems and consistently apply best practices in data engineering, data governance, and performance optimization. You take ownership of data solutions from design through deployment and ongoing optimization., * Design, develop, and maintain robust and scalable data pipelines using Apache Spark and cloud-native data services. * Build, optimize, and support ETL/ELT workflows to enable analytics, reporting, and downstream applications. * Implement and manage data solutions using Databricks, Delta Lake, and Unity Catalog. * Ensure data quality, reliability, and performance across large-scale and complex datasets. * Collaborate with cross-functional teams to gather data requirements and translate them into effective technical solutions. * Apply data engineering best practices related to scalability, security, monitoring, and maintainability. * Support the continuous improvement of data architecture, pipeline performance, and operational stability in a cloud environment. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)