Azure Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+21 more
Job description
β Design, develop, and maintain data pipelines using Azure Databricks (PySpark/Spark SQL) and Delta Lake. β Build and orchestrate ETL/ELT workflows in Azure Data Factory, including linked services, datasets, and triggers. β Write and optimize complex SQL for data transformation, aggregation, and performance tuning. β Collaborate with cross-functional teams to deliver reliable, high-quality data solutions. β Implement data quality checks, monitoring, and follow engineering best practices. β Work in an Agile environment and contribute to sprint planning and retrospectives.
Requirements
We are seeking a skilled Azure Data Engineer with strong hands-on expertise in Azure Databricks (ADB), Azure Data Factory (ADF), and SQL. The ideal candidate will design and build scalable data pipelines and transformations on the Azure platform, with solid experience in Spark (PySpark), the Databricks Lakehouse, and ETL/ELT orchestration. Exposure to Delta Lake, data modeling, and CI/CD for data workloads is a plus., β Databricks: Strong proficiency in Azure Databricks, PySpark, Spark SQL, and notebook development. β Data Integration: Hands-on experience with Azure Data Factory (pipelines, mapping data flows, triggers). β Database: Expert-level SQL (mandatory) with T-SQL/Spark SQL; query optimization and stored procedures. β Storage & Format: Experience with Delta Lake, Parquet, and Azure Data Lake Storage (ADLS Gen2). β Data Modeling: Understanding of dimensional modeling and data warehousing concepts. β Version Control: Git/Azure Repos or similar tools. β CI/CD: Familiarity with Azure DevOps pipelines for data deployments. β Cloud: Working knowledge of the broader Azure ecosystem (Key Vault, Synapse is a plus).
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦