Azure Data Engineer

We re partnering with a confidential, enterprise-scale organization to hire a Senior Azure Data Engineer with deep expertise in Azure Databricks to help design, build, and optimize a modern lakehouse data platform. You ll develop scalable ETL/ELT pipelines, implement Medallion (Bronze/Silver/Gold) patterns, and enable advanced analytics in a high-volume environment. This role collaborates closely with data architects, data scientists, business stakeholders, and cloud/infrastructure teams to deliver secure, reliable, high-performance data solutions. What You ll Do

• Design and build scalable ETL/ELT pipelines using Azure Databricks (PySpark, Spark SQL).
• Develop ingestion workflows from multiple source systems (e.g., Event Hub, APIs, Azure SQL, Blob Storage) into Bronze/Silver/Gold layers.
• Implement best practices for Delta Lake and Unity Catalog (schema evolution, versioning, governance).
• Optimize pipeline performance and cost through partitioning, caching, clustering, and Spark tuning.
• Integrate Databricks with ADLS Gen2, Azure Data Factory (ADF), Azure Synapse, Event Hub, Key Vault, and Azure DevOps.
• Implement secure access controls using managed identities, RBAC, and data protection practices (e.g., masking).
• Partner with analytics and business teams to deliver trusted datasets, metrics, and KPIs.
• Provide technical leadership through mentoring, code reviews, and architectural guidance.
• Work with enterprise architecture and security teams to align with data privacy/security policies.
• Implement data quality checks, alerting, and lineage tracking using tools such as Great Expectations, Unity Catalog, and data observability platforms.
• Build monitoring dashboards, alerts, and recovery mechanisms for critical pipelines.

• Bachelor s degree in Computer Science, Engineering, or related field (or equivalent experience).
• 5+ years of data engineering experience, including 3+ years with Azure Databricks / Apache Spark (PySpark).
• Strong experience with Delta Lake, Unity Catalog, Databricks notebooks, and SQL-based warehousing patterns.
• Hands-on experience with ADLS Gen2, Event Hub, ADF, Key Vault, Synapse.
• Strong coding skills in Python and SQL; familiarity with Scala is a plus.
• Solid understanding of data modeling (OLTP/OLAP), star/snowflake schemas, and performance tuning.
• Experience implementing CI/CD for Databricks using Databricks CLI, Terraform, and/or Azure DevOps.
• Databricks certification (e.g., Databricks Certified Data Engineer Professional).
• Streaming/real-time pipelines (Structured Streaming, Event Hub, Kafka).
• ML platform exposure (e.g., MLflow or supporting ML pipelines).
• Reporting/consumption layer experience (e.g., Power BI, Purview, Microsoft Fabric).
• Knowledge of governance/compliance standards (GDPR, HIPAA, SOC2).

Estimated Min Rate: $105000.00 Estimated Max Rate: $150000.00

What s In It for You? We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh s extensive talent community that will provide you with access to Yoh s vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:

• Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
• Health Savings Account (HSA) (for employees working 20+ hours per week)
• Life & Disability Insurance (for employees working 20+ hours per week)
• MetLife Voluntary Benefits
• Employee Assistance Program (EAP)
• 401K Retirement Savings Plan
• Direct Deposit & weekly epayroll
• Referral Bonus Programs
• Certification and training opportunities