> Markdown version of [/jobs/ext/1388963-applications-developer-databricks](https://www.wearedevelopers.com/jobs/ext/1388963-applications-developer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Applications Developer - DataBricks - **Company:** ThreePDS Inc - **Location:** New York, NY, United States - **Experience:** Experienced - **Salary:** $158,080.0 - $162,240.0 - **Contract:** Temporary contract - **Skills:** Amazon Web Services, Data Analysis, Microsoft Azure, Cloud Database, Computer Programming, Data Architecture, Information Engineering, Extract Transform Load (ETL), Data Systems, Python (Programming Language), Oracle (Applications), Cloud Services, Standard Sql, Anaplan, Systems Integration, Enterprise Data Management, Azure Service Bus, Google Cloud, Azure Data Factory, Sql Optimization, Apache Spark, Data Lakes, Apache Kafka, Data Management, Data Pipelines, Databricks - **Published:** July 22, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=262b9921f8243e66 ## About the Role The ideal candidate has strong experience with Databricks, modern cloud data platforms, ETL/ELT development, and enterprise data architecture, along with the ability to partner with business stakeholders to deliver reliable, high-performing data solutions., * Minimum of 7 years of data engineering experience. * At least 3 years of hands-on Databricks development experience. * Strong experience with: + Databricks + Delta Lake + Delta Live Tables + Unity Catalog + Databricks Workflows * Advanced SQL skills. * Strong programming experience with Python and/or Scala. * Experience building ETL/ELT pipelines, enterprise data models, and scalable data architectures. * Experience integrating Databricks with Azure, AWS, or Google Cloud Platform. * Experience working with enterprise data integration technologies such as Azure Data Factory, Event Hubs, Kafka, or similar tools. * Experience supporting Sales Incentive Compensation (SIC) processes, including incentive plans, quota management, commission calculations, attainment tracking, and payout processing. * Strong analytical, troubleshooting, and problem-solving skills. * Excellent communication and stakeholder management abilities. * Ability to work independently while collaborating effectively within a team environment., * Experience with incentive compensation platforms such as Anaplan, Oracle ICM, Varicent, or similar solutions. * Databricks Certified Data Engineer Associate or Professional certification. * Experience designing enterprise-scale cloud data solutions. Key Skills * Databricks * Python * SQL * Apache Spark * ETL / ELT * Delta Lake * Data Modeling * Cloud Data Platforms * Azure Databricks * Data Engineering, We're looking for a collaborative Data Engineer who enjoys solving complex data challenges and building scalable, enterprise-grade data solutions. The ideal candidate is a team player with strong technical expertise, excellent communication skills, and a passion for delivering high-quality, reliable data platforms in a fast-paced environment. ## Description We are seeking an experienced DataBricks Data Engineer to join a growing team supporting a new enterprise data initiative. This role is responsible for designing, developing, and optimizing scalable data engineering solutions using Databricks to support analytics, reporting, enterprise data pipelines, and Sales Incentive Compensation (SIC) processes., * Design, develop, and maintain scalable data pipelines using the Databricks platform. * Build and optimize Delta Lake tables, Delta Live Tables, Unity Catalog, notebooks, workflows, and enterprise data models. * Design data architectures that support reporting, analytics, and enterprise business processes. * Develop ETL/ELT solutions to ingest, transform, validate, and deliver high-quality data. * Support Sales Incentive Compensation (SIC) processes, including quota management, attainment calculations, commission processing, and payout reporting. * Partner with Sales Operations, Finance, IT, and business stakeholders to translate business requirements into scalable technical solutions. * Maintain and optimize existing Databricks environments by improving automation, integration, data quality, and overall performance. * Troubleshoot, test, and resolve issues within data pipelines while ensuring reliability and scalability. * Integrate Databricks with cloud platforms and enterprise data sources. * Create and maintain technical documentation for data models, pipeline architecture, and development standards. * Stay current with Databricks capabilities and recommend improvements that enhance performance and efficiency. ## Related Videos - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post) - [The Data Mesh as the end of the Datalake as we know it](https://www.wearedevelopers.com/videos/156-the-data-mesh-as-the-end-of-the-datalake-as-we-know-it) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)