Azure Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Job description
We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and analytics solutions. The ideal candidate will have hands-on experience with Databricks, dbt, Apache Spark, Python, Azure Data Factory, SQL Server, and Power BI, with knowledge of SSIS/SSRS being an added advantage., * Design, build, and optimize ETL/ELT data pipelines using Azure Data Factory and Databricks.
- Develop scalable data processing solutions using Apache Spark (PySpark).
- Create and maintain data transformation models using dbt.
- Write optimized SQL queries, stored procedures, and database objects in SQL Server.
- Develop Python scripts for data ingestion, transformation, and automation.
- Build and maintain data warehouses and data lakes.
- Develop dashboards and reports using Power BI.
- Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
- Collaborate with business stakeholders, analysts, and developers to deliver data solutions.
- Implement data quality, governance, and security best practices.
- Maintain technical documentation and support production deployments.
Requirements
- Strong experience with Databricks.
- Hands-on experience with dbt.
- Strong knowledge of Apache Spark (PySpark).
- Proficiency in Python.
- Experience with Azure Data Factory.
- Advanced SQL Server development skills.
- Experience creating reports and dashboards in Power BI.
- Understanding of data warehousing concepts and ETL/ELT processes.
- Experience with Git and CI/CD practices.
Preferred Skills
- Experience with SSIS and/or SSRS.
- Experience with Azure Synapse Analytics.
- Knowledge of Delta Lake, Unity Catalog, and Azure DevOps.
- Familiarity with Agile/Scrum methodologies., * Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 3-8+ years of experience in Data Engineering or Business Intelligence.
- Microsoft Azure certifications are a plus.
Requirements added by the job poster
-
6+ years of work experience with Azure Databricks
-
2+ years of work experience with Apache Spark
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
What Are The Top Skills Required For Azure Developers?
The Most Popular IT Jobs on the Market
Top-Paying Tech Jobs (with Salaries)
Data Analyst Salary in the UK