> Markdown version of [/jobs/ext/3010395-senior-azure-ml-infrastructure-engineer](https://www.wearedevelopers.com/jobs/ext/3010395-senior-azure-ml-infrastructure-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Azure ML Infrastructure Engineer - **Company:** Simpson Thacher & Bartlett LLP - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $160,000.0 - $180,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Microsoft Azure, Bash Shell, Cloud Computing, Cloud Engineering, Information Systems, Continuous Integration, DevOps, Distributed Computing Environment, Github, Monitoring of Systems, Python (Programming Language), Machine Learning, Performance Tuning, Windows PowerShell, Role-Based Access Control, Azure Active Directory, Prometheus, Azure Machine Learning, Azure Data Lake, Management of Software Versions, Datadog, Scripting, Azure Data Factory, Cloud Monitoring, Grafana, IT Architecture, Deep Learning, Containerization, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Deployment Automation, Bicep, Azure AKS, Machine Learning Operations, Terraform, Azure Synapse Analytics, Docker, Jenkins, Databricks - **Published:** September 20, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=580411449ea16470 ## About the Role * Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience in lieu of formal education. * Legal IT experience a plus but not required SKILLS AND EXPERIENCE Required * 5+ years of experience in ML infrastructure, cloud engineering, or MLOps * 2+ years of experience working in Azure environments. * Deep hands-on experience with Azure cloud services relevant to ML, including Azure Machine Learning, AKS, Blob Storage, Databricks, Azure Data Factory, and Synapse. * Strong expertise in containerization (Docker) and orchestration (Kubernetes, preferably AKS). * Proficient in Python and scripting languages (e.g., Bash, PowerShell). * Advanced knowledge of CI/CD tools such as Azure DevOps, GitHub Actions, or Jenkins for ML workloads. * Solid understanding of IaC tools: Terraform, Bicep, or ARM templates. Preferred * Microsoft Azure certifications (e.g., Azure AI Engineer Associate, Azure Solutions Architect Expert, or DevOps Engineer Expert). * Experience designing ML infrastructure in regulated industries (finance, healthcare, etc.). * Familiarity with feature stores, distributed training, and model monitoring frameworks. * Leadership experience in building infrastructure for ML at scale., The actual salary offered will depend on a variety of factors, including without limitation, the qualifications of the individual applicant for the position, years of relevant experience, level of education attained, certifications or other professional licenses held, and if applicable, the location in which the applicant lives and/or from which they will be performing the job. This role is exempt meaning it is not overtime pay eligible. ## Description Infrastructure Architecture & Engineering * Lead the architecture and implementation of production-grade ML infrastructure using Azure Machine Learning, AKS, Azure Data Lake, Azure Databricks, and related services. * Design scalable training and inference environments for deep learning and traditional ML workloads, optimizing performance and cost. MLOps Strategy & Execution * Define and implement MLOps best practices: versioning, CI/CD for ML pipelines, monitoring, and model governance. * Automate end-to-end ML workflows using tools such as MLFlow, Azure ML Pipelines, or Kubeflow. * Build reusable templates and frameworks to standardize ML deployment across teams. Cross-Functional Leadership * Collaborate with data scientists to productionize models, offering guidance on infrastructure, deployment strategies, and performance optimization. * Partner with DevOps and platform engineering teams to align infrastructure with broader cloud strategies and compliance standards. * Mentor junior ML and platform engineers, sharing best practices and driving engineering excellence. Security, Reliability, and Observability * Implement enterprise-grade security and compliance controls using Azure Active Directory, RBAC, and data encryption strategies. * Integrate observability tooling (e.g., Azure Monitor, Prometheus, Grafana) for end-to-end monitoring of ML systems. * Ensure systems are highly available, reliable, and scalable to meet the demands of production ML workloads. ## Related Videos - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Back(end) to the Future: Embracing the continuous Evolution of Infrastructure and Code](https://www.wearedevelopers.com/videos/440-back-end-to-the-future-embracing-the-continuous-evolution-of-infrastructure-and-code) - [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)