Data Platform
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Requirements
We are looking for an engineer who can build and operate Microsoft Fabric data pipelines, and who also has hands-on experience with CI/CD and cloud infrastructure automation. You will work with data and platform teams to deliver reliable, repeatable, and secure deployments across dev, ppe, and prod environments. Key Responsibilities * Design, deploy, and maintain Microsoft Fabric pipelines (Data Factory in Fabric, Dataflows Gen2, notebooks, Lakehouses, Warehouses). * Implement Fabric deployment pipelines and Git integration for promotion across workspaces and environments. * Build and maintain CI/CD pipelines in Azure DevOps or GitHub Actions for data and infrastructure artifacts. * Provision and manage Azure infrastructure using Infrastructure as Code (Bicep preferred; Terraform is a plus). * Parameterize and standardize deployments per environment, including naming conventions and reusable modules. * Apply safe deployment practices: validation, what-if, approvals, staged rollouts, and rollback plans. * Monitor pipeline health, troubleshoot failures, and improve reliability and performance. * Secure the platform: managed identities, RBAC, Key Vault, private endpoints, and no secrets in code. * Document solutions and runbooks, and collaborate with data engineers, architects, and security teams. Required Qualifications * 3+ years of experience in data engineering, DevOps, or platform engineering. * Hands-on experience deploying Microsoft Fabric pipelines and workspaces (or Azure Data Factory/Synapse with a clear migration path to Fabric). * Strong experience with CI/CD tooling (Azure DevOps Pipelines, GitHub Actions) including multi-stage release pipelines. * Working knowledge of Infrastructure as Code (Bicep, ARM, or Terraform). * Proficiency with Git workflows, branching strategies, and pull request reviews. * Scripting skills in PowerShell, Azure CLI, or Python. * Solid understanding of Azure fundamentals: networking, identity (Entra ID), storage, and monitoring. Preferred Qualifications * Experience with Express V2 (EV2) or similar safe-deployment orchestration. * Familiarity with the Fabric REST APIs and automation of workspace, capacity, and item management. * Experience with Azure Policy, governance, and compliance-driven deployments. * Knowledge of Spark, SQL, and Delta Lake/OneLake concepts. * Experience with observability tools (Azure Monitor, Log Analytics, alerting). * Relevant certifications: DP-600, DP-700, AZ-400, AZ-104, or AZ-305. Core Competencies * Automation-first mindset with attention to repeatability and quality. * Clear written and verbal communication. * Ownership, troubleshooting skills, and the ability to work across teams.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦