Databricks Engineer

We are seeking an experienced Databricks Data Engineer to join a team building a homegrown sales incentive compensation and data platform. In this role, you will design, develop, and support scalable data engineering solutions using Databricks to enable data ingestion, transformation, analytics, reporting, and incentive compensation processing.

This role is ideal for a hands-on engineer who can translate complex business requirements into reliable data pipelines and integrated technical solutions.

Responsibilities

• Design and build Databricks-based data pipelines, data models, Delta Lake tables, notebooks, and workflows
• Own and support the overall Databricks architecture
• Maintain and optimize existing Databricks workspaces, pipelines, and automation
• Translate business and functional requirements into scalable technical solutions
• Build pipelines supporting Sales Incentive Compensation processes, including quota management, attainment calculations, commission processing, and payout reporting
• Partner with Sales Operations and Finance to model incentive plan rules accurately
• Test, debug, and troubleshoot data pipelines and notebooks
• Support end users and analysts with Databricks-based solutions
• Document data models, pipeline configurations, and technical processes
• Collaborate with finance, IT, BI, and other cross-functional teams

• 7+ years of data engineering experience
• 3+ years of hands-on Databricks experience
• Strong experience with Databricks components such as Delta Lake, Delta Live Tables, Unity Catalog, and Workflows
• Strong proficiency in Python and/or Scala
• Advanced SQL skills
• Experience with ETL/ELT, data ingestion, transformation, data modeling, and orchestration
• Ability to solve complex data and business problems
• Excellent communication and stakeholder management skills
• Ability to work independently and as part of a team
• Comfortable working across global time zones

Preferred

• Experience with Sales Incentive Compensation processes
• Familiarity with SIC platforms such as Anaplan, Oracle ICM, or Varicent
• Experience integrating Databricks with Azure, AWS, or GCP
• Exposure to Azure Data Factory, Event Hubs, Kafka, or similar tools
• Databricks certification a plus