Data Engineer Azure Databricks

Kanshe Infotech
Warren, NJ, United States
about 2 months ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Microsoft Azure Continuous Integration Extract Transform Load (ETL) Python (Programming Language) Log Analysis Standard Sql Azure Data Lake Azure Data Factory Apache Spark Data Lakes Information Technology
+3 more
Data Pipelines Key Vault Databricks

Requirements

We are seeking a Senior Data Engineer with strong Azure Databricks and Lakehouse experience to design and deliver scalable enterprise data solutions., * 15+ years of overall IT experience.

  • Strong hands-on experience with Azure Databricks, Lakehouse, and Delta Lake.
  • Experience with Azure Data Factory (ADF) and ADLS Gen2.
  • Strong SQL and Python skills.
  • Experience with Apache Spark and ETL/ELT development.
  • Experience designing scalable batch and real-time data pipelines.
  • Strong knowledge of data modeling, data quality, security, and governance.
  • Experience with Azure DevOps, CI/CD, and Agile environments.
  • Strong technical leadership and stakeholder communication skills.
  • Azure Databricks Certification is mandatory.

Preferred Skills:

  • Experience with Unity Catalog.
  • Experience with Synapse Analytics, Key Vault, Azure Monitor, or Log Analytics.
  • Experience with performance and cost optimization.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…