Senior DevOps Engineer (Azure) - bilbao

• Design and operate CI/CD pipelines in Azure DevOps for every domain team, using Databricks Asset Bundles as the deployment substrate.
• Manage Databricks workspaces, clusters, jobs and policies through infrastructure as code (Terraform).
• Own environment promotion (dev / test / prod), release governance and rollback.
• Set up observability across pipelines and platform components: logs, metrics, alerting and operational dashboards.
• Implement FinOps guardrails: autoscaling, cold-tier storage, cost tagging per domain and weekly cost reviews.
• Manage secrets, service principals, network configuration and identity integration with Azure AD.
• Automate quality gates, security scans and standards checks in the CI pipeline so generated and hand-written code both go through the same checks.
• Enable the agentic tooling loop by exposing platform APIs to MCP servers where appropriate.

Why this position:

Shape the delivery backbone of a large-scale enterprise data platform migration: building the CI/CD, environment and automation foundations that let engineering teams ship pipelines and domain migrations reliably across a 70+ sub-domain programme. You’ll work hands-on with the leading edge of the Databricks ecosystem on a high-stakes lakehouse build, applying modern automation and agentic tooling to keep delivery fast and consistent as the platform scales.

• 5+ years of DevOps or platform engineering, with recent hands-on Azure experience.
• Strong Terraform, Azure DevOps pipelines and Databricks Asset Bundles.
• Experience running Databricks in production: workspaces, Unity Catalog metastore, cluster policies, jobs, SQL Warehouses.
• Comfort with Azure identity, networking, storage and security fundamentals.
• Track record of building CI/CD for data platforms, not just application deployment.
• Experience with observability stacks (Datadog, Grafana, Azure Monitor or similar).
• Fluent working English.

Nice to have

• FinOps Foundation certification or equivalent cost management experience.
• Active Databricks certifications
• Experience integrating MCP servers or agentic tooling with cloud and Databricks APIs.
• Financial services background.

Our client is an independent, active global asset manager with over R3 trillion in assets under management. They are executing a firm-wide data strategy to govern, manage and engineer data as a product across more than 70 business-owned sub-domains.

As part of this, they are migrating to Databricks as the foundational layer of their Enterprise Data Platform, adopting a lakehouse architecture built on open formats, declarative pipelines and Unity Catalog.