> Markdown version of [/jobs/ext/2246554-azure-data-engineer-associate](https://www.wearedevelopers.com/jobs/ext/2246554-azure-data-engineer-associate). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Azure Data Engineer Associate - **Company:** Class Valuation, LLC - **Location:** Milpitas, CA, United States - **Experience:** Expert - **Salary:** $149,760.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Microsoft Azure, Batch Processing, Business Intelligence Development, Big Data, Cloud Database, Cloud Storage, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Transformation, Data Systems, Data Warehousing, Relational Databases, DevOps, Github, Apache Hive, Python (Programming Language), Key Management, Scrum Methodology, Standard Sql, Azure Data Lake, Data Streaming, Azure Service Bus, Google Cloud, Cloud Platform System, Azure Data Factory, Apache Spark, Git, Data Lakes, Pyspark, Information Technology, Deployment Automation, Apache Kafka, Machine Learning Operations, Terraform, Azure Synapse Analytics, Stream Analytics, Software Version Control, Data Pipelines, Databricks - **Published:** August 26, 2026 - **Apply:** https://www.dice.com/job-detail/19781994-016d-45f3-a83b-0b9682ba0d17 ## About the Role Core Technologies * Databricks Lakehouse Platform * Apache Spark * PySpark * Spark SQL * Delta Lake * Python * SQL Cloud Platforms (one or more) * Microsoft Azure (preferred) * AWS * Google Cloud Platform Azure Technologies (Preferred) * Azure Data Factory (ADF) * Azure Data Lake Storage (ADLS Gen2) * Azure Synapse Analytics * Azure Key Vault * Azure DevOps Data Engineering * Data Warehousing * Data Modeling * ETL/ELT Development * Batch Processing * Streaming (Kafka/Event Hubs) * Data Lake Architecture DevOps & Version Control * Git * Azure DevOps / GitHub * CI/CD Pipelines Preferred Qualifications * Experience with Unity Catalog. * Knowledge of Databricks Workflows and Jobs. * Hands-on experience with Delta Live Tables (DLT). * Exposure to MLflow is an added advantage. * Experience with data governance and security best practices. * Familiarity with Infrastructure as Code (Terraform) is a plus. Educational Qualification * Bachelor''s or Master''s degree in Computer Science, Information Technology, Engineering, or a related field. Preferred Certifications * Databricks Certified Data Engineer Associate * Databricks Certified Data Engineer Professional * Microsoft Certified: Azure Data Engineer Associate (DP-203) * Azure Fundamentals (AZ-900) Good to Have * Experience with real-time analytics. * Knowledge of Lakehouse architecture. * Experience with Agile/Scrum methodologies. * Strong analytical and problem-solving skills. * Excellent communication and stakeholder management abilities. ## Description We are looking for a skilled Databricks Engineer with strong expertise in designing, developing, and optimizing modern data engineering solutions on the Databricks Lakehouse Platform. The ideal candidate should have experience building scalable ETL/ELT pipelines, working with large-scale data, and leveraging Apache Spark to deliver high-performance data solutions., * Design, develop, and maintain scalable data pipelines using Databricks. * Build ETL/ELT workflows for batch and streaming data processing. * Develop solutions using PySpark, Spark SQL, and Delta Lake. * Implement Medallion Architecture (Bronze, Silver, Gold) for data transformation. * Integrate data from various sources including relational databases, APIs, cloud storage, and streaming platforms. * Optimize Spark jobs for performance, scalability, and cost efficiency. * Collaborate with Data Architects, Data Scientists, BI developers, and business stakeholders. * Implement CI/CD pipelines and deployment automation for Databricks workloads. * Ensure data quality, security, governance, and compliance. * Monitor, troubleshoot, and optimize production data pipelines. * Document technical solutions and follow engineering best practices., * Databricks * PySpark * Spark SQL * Delta Lake * Python * SQL * Azure/AWS/Google Cloud Platform (at least one cloud platform) * ETL/ELT Development * Data Lake Architecture Nice to Have * Unity Catalog * Delta Live Tables (DLT) * MLflow * Kafka/Event Hubs * Azure Data Factory * Terraform * Azure DevOps/GitHub Actions ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)