Senior DevOps Engineer - Azure & Databricks (AI/ML Focus)

Acuity INC
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 66K

Job location

Tech stack

Artificial Intelligence
Azure
Continuous Integration
Data Architecture
Data Governance
DevOps
Python
Machine Learning
TensorFlow
Software Engineering
Scripting (Bash/Python/Go/Ruby)
PyTorch
Infrastructure as Code (IaC)
Containerization
Scikit Learn
Kubernetes
Machine Learning Operations
Terraform
Docker
Databricks

Job description

We are seeking a Senior DevOps Engineer with expertise in Azure Databricks and cloud-native AI/ML operations. You will be a key contributor to a next-generation AI platform built on Azure Databricks, enabling data scientists and engineers to train, deploy, monitor, and govern ML and GenAI models efficiently. This role blends MLOps best practices, cloud-native architecture, and Databricks expertise to ensure AI models are production-ready, scalable, and compliant with enterprise standards., * Design, implement, and optimize ML/AI pipelines for training, deployment, monitoring, and governance.

  • Leverage Azure Databricks capabilities including MLFlow for experiment tracking and Unity Catalog for data governance.
  • Build and maintain CI/CD pipelines as well as automated ModelOps workflows for AI/ML applications.
  • Ensure data architecture supports schema evolution, governance, and compliance requirements.
  • Operate in a cloud-native Azure environment to deliver robust and scalable ML solutions.

Requirements

  • Proven experience with Azure Databricks, including MLFlow and Unity Catalog.
  • Strong background in DevOps for ML/AI, including CI/CD and pipeline automation.
  • Solid understanding of data architecture, schema evolution, and governance principles.
  • Experience working in Microsoft Azure or similar cloud environments.
  • Hands-on experience with Infrastructure as Code (IaC) using Terraform.

Nice to Have

  • High-level understanding of machine learning and generative AI concepts and workflows.
  • Solid knowledge of containerization (Docker) and orchestration (Kubernetes).
  • Experience in Python software development and scripting.
  • Hands-on experience with TensorFlow, PyTorch, and Scikit-learn in a Databricks environment.

About the company

Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We delivers deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency. Please note that this role is currently available for European residents.

Apply for this position