Azure Databricks Data Engineer
P2PSoftTek Inc
Pittsburgh, PA, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Continuous Integration
Information Engineering
Data Governance
Extract Transform Load (ETL)
Meta-Data Management
Scrum Methodology
Azure Data Lake
SQL Databases
Azure Data Factory
Apache Spark
Git
+5 more
Data Lakes
Pyspark
Bicep
Terraform
Databricks
Requirements
- 8+ years of overall Data Engineering experience
- 5+ years of hands-on experience with Azure Databricks
- Mandatory experience with Unity Catalog
- Strong expertise in PySpark, SQL, and Delta Lake
- Experience with Azure Data Factory (ADF) and ADLS Gen2
- Strong background in building enterprise-scale Azure data engineering solutions
- Experience with ETL/ELT development and Apache Spark optimization
- Knowledge of data governance, metadata management, and access control
- Experience with Git, CI/CD, and Agile/Scrum environments
- Mandatory experience in the Investment/Capital Markets domain
Preferred:
- Databricks Certified Data Engineer (Associate/Professional)
- Microsoft Azure Data Engineer Associate (DP-203)
- Experience with Terraform/Bicep, Azure DevOps, or Microsoft Purview
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦