Engineer Senior Engineer Devops

Proven experience as a DevOps Engineer, Cloud Engineer, or DataOps Engineer working in Azure-based data platforms, supporting complex, large-scale workloads within mature Agile delivery environments.

Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration.

Strong experience with Azure DevOps YAML pipelines, Git branching strategies, artifact management, automated testing, and environmental promotion workflows.

Expert-level knowledge of Terraform for provisioning Databricks resources, Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure.

Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking, Azure Log Analytics, and Azure AD.

Proficient in scripting with Python, Bash, or PowerShell, with experience developing automation scripts, deployment utilities, and system health monitoring tools.

Experience designing and implementing monitoring, logging, and observability solutions for data pipelines running in Azure Databricks, including cluster/job metrics, cost telemetry, and platform-level operational dashboards.

Strong communication, documentation, and stakeholder management skills, collaborating effectively with technical and business teams.

Understanding FinOps practices, including monitoring Azure cost drivers, analyzing Databricks cost patterns, and implementing optimization strategies.