Sr. Data Engineer - Databricks
Role details
Job location
Tech stack
Job description
As a Sr. Data Engineer - Databricks, you are responsible for designing, building, and maintaining scalable data solutions that enable analytics, reporting, and data-driven decision making across the organization. You bring deep experience working with modern data platforms and enjoy transforming complex data into reliable, high-quality datasets. You thrive in collaborative environments, partnering with analytics, engineering, and business teams to deliver impactful data pipelines. You are comfortable working in cloud-based ecosystems and consistently apply best practices in data engineering, data governance, and performance optimization. You take ownership of data solutions from design through deployment and ongoing optimization., * Design, develop, and maintain robust and scalable data pipelines using Apache Spark and cloud-native data services.
- Build, optimize, and support ETL/ELT workflows to enable analytics, reporting, and downstream applications.
- Implement and manage data solutions using Databricks, Delta Lake, and Unity Catalog.
- Ensure data quality, reliability, and performance across large-scale and complex datasets.
- Collaborate with cross-functional teams to gather data requirements and translate them into effective technical solutions.
- Apply data engineering best practices related to scalability, security, monitoring, and maintainability.
- Support the continuous improvement of data architecture, pipeline performance, and operational stability in a cloud environment.
Requirements
Do you have experience in Spark?, * 7+ years of experience in data engineering or a related technical role.
- Strong hands-on experience with Databricks and Apache Spark are required.
- Experience working with Delta Lake and Unity Catalog for data management and governance.
- Solid understanding of data pipeline design, ETL/ELT patterns, and data modeling concepts.
- Experience working with cloud data platforms such as Azure, AWS, or GCP.
- Proven ability to design scalable, reliable, and high-performing data solutions.
- Strong problem-solving skills and the ability to work effectively in collaborative, fast-paced environments.