Azure Databricks Data Engineer
TALENT Software Services
Louisville, KY, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source
Tech stack
Agile Methodology
Data Analysis
Microsoft Azure
Continuous Integration
Data Integration
Software Debugging
Scrum Methodology
Azure Data Factory
Data Lakes
Enterprise Integration
Data Pipelines
Databricks
Job description
- Work on Agile development projects and participate in sprint delivery.
- Design and implement data integration solutions in Microsoft Azure.
- Develop and maintain data pipelines using Azure Data Factory.
- Ingest data from various source systems into Azure.
- Perform data transformations using Azure Databricks and Delta Lake.
- Implement and maintain workflows using Prefect.
- Perform data analysis and troubleshooting for data-related issues.
- Assist in identifying and resolving data quality and pipeline issues.
- Collaborate with development teams to support CI/CD processes using Azure DevOps.
- Act as an individual contributor and problem solver.
- Participate in Agile ceremonies, sprint planning, and delivery activities.
Requirements
- Experience developing and implementing data pipelines using Azure Data Factory (ADF).
- Experience ingesting data from multiple sources using Azure ADF.
- Experience transforming data using Azure Databricks and Delta Lake.
- Experience with Azure DevOps for CI/CD, including:
- Stories
- Bugs
- Issue management
- Experience implementing Prefect.
- Strong hands-on experience with Databricks.
- Experience working with Microsoft Azure integration solutions., * Experience working in Agile development environments.
- Experience with sprint planning and sprint delivery.
- Strong analytical and problem-solving skills.
- Ability to work independently as an individual contributor.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦