Data Engineer -Databricks
Mastech Digital, Inc.
Pittsburgh, PA, United States
7 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.disabledperson.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source
Tech stack
Agile Methodology
Microsoft Azure
Continuous Integration
Apache Hadoop
Apache Hive
Performance Tuning
Cloud Services
Standard Sql
Azure Data Lake
Azure Data Factory
Apache Spark
Git
+8 more
Data Lakes
Pyspark
Collibra
Bicep
Data Management
Terraform
Data Pipelines
Databricks
Job description
- Build and optimize scalable data pipelines using Azure Databricks, PySpark, and Delta Lake
- Implement and manage Unity Catalog for governance, security, and access control
- Migrate traditional data platforms to modern Databricks Lakehouse solutions
- Develop cloud-native data engineering solutions on Azure
- Support CI/CD deployments, performance tuning, and production support
- Work closely with business and technical stakeholders in an Agile environment
Preferred
- Databricks Data Engineer Certification
- Azure Data Engineer (DP-203)
- Terraform/Bicep
- Azure Purview
Requirements
- 5+ years of Azure Databricks
- Strong PySpark / Apache Spark and SQL
- Hands-on Unity Catalog experience (migration experience preferred)
- Azure Data Factory (ADF) and ADLS Gen2
- CI/CD, Git, Azure DevOps
- Experience migrating legacy/Hadoop/Hive platforms to Databricks
- Investment Banking / Capital Markets / Securities domain experience
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.disabledperson.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦