> Markdown version of [/jobs/ext/4014042-ai-devops-engineer](https://www.wearedevelopers.com/jobs/ext/4014042-ai-devops-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI DevOps Engineer - **Company:** Ova Technologies - **Location:** New York, NY, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Airflow, Amazon Web Services, Automation of Tests, Microsoft Azure, Bash Shell, Cloud Computing, Cloud Computing Security, Cloud Engineering, Nvidia CUDA, Continuous Integration, Linux, DevOps, Disaster Recovery, Github, Monitoring of Systems, Identity and Access Management, Python (Programming Language), Key Management, PostgreSQL, Linux System Administration, Machine Learning, Octopus Deploy, Redis, Release Management, Reliability Engineering, Prometheus, Azure Machine Learning, Software Deployment, Software Engineering, AI Infrastructure, Data Logging, Pulumi, Google Cloud, Istio, Delivery Pipeline, Large Language Models, Grafana, Apache Spark, Generative AI, Infrastructure as Code (IaC), Git, Cloudformation, AI Platforms, Gitlab-ci, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Deployment Automation, Apache Kafka, Linkerd (Service Mesh), Ray Serve, Data Management, Triton Inference Server, Machine Learning Operations, Cloud Optimization, Terraform, Splunk, Docker, KServe, Elk Stack, Jenkins - **Published:** October 29, 2026 - **Apply:** https://www.thejobnetwork.com/job/4451037f-81cc-495e-82e8-c1020f345422/ai-devops-engineer ## About the Role * Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field. * 4 years of experience in DevOps, Cloud Engineering, Platform Engineering, or Site Reliability Engineering (SRE). * Experience supporting AI, machine learning, or data platforms in production environments. * Strong programming and scripting skills in Python and Bash; Go is a plus. * Hands-on experience with Docker and Kubernetes. * Experience with AWS, Microsoft Azure, or Google Cloud Platform. * Experience building CI/CD pipelines using GitHub Actions, GitLab CI, Azure DevOps, or Jenkins. * Experience with Infrastructure as Code tools such as Terraform or Pulumi. * Strong understanding of Linux administration, networking, and cloud security. * Experience with monitoring and observability tools such as Prometheus, Grafana, OpenTelemetry, ELK Stack, or Splunk. Preferred Qualifications * Experience with MLOps platforms such as MLflow, Kubeflow, SageMaker, Vertex AI, or Azure Machine Learning. * Experience deploying Large Language Models (LLMs) and Generative AI applications. * Knowledge of model serving frameworks such as KServe, NVIDIA Triton Inference Server, Ray Serve, or BentoML. * Experience with vector databases and Retrieval-Augmented Generation (RAG) architectures. * Familiarity with Apache Airflow, Kafka, Ray, or Apache Spark. * Experience with GPU-enabled infrastructure and NVIDIA CUDA environments. * Understanding of AI governance, Responsible AI, and model monitoring practices. Technical Skills * Python * Bash * Go (preferred) * Docker * Kubernetes * Terraform / Pulumi / CloudFormation * Git * GitHub Actions * GitLab CI * Azure DevOps * Jenkins * AWS / Azure / Google Cloud Platform * Linux * Prometheus * Grafana * OpenTelemetry * ELK Stack * Splunk * MLflow * Kubeflow * SageMaker * Vertex AI * Azure Machine Learning * KServe * NVIDIA Triton Inference Server * Ray Serve * BentoML * PostgreSQL * Redis Soft Skills * Strong analytical and troubleshooting skills * Excellent communication and cross-functional collaboration * Ownership and accountability * Ability to thrive in Agile and DevOps environments * Strong automation mindset * Continuous learning and adaptability Nice to Have * Experience with LLMOps and Generative AI deployment pipelines * Experience implementing GitOps using Argo CD or Flux * Knowledge of service mesh technologies such as Istio or Linkerd * Experience with FinOps and cloud cost optimization * Cloud, Kubernetes, or DevOps certifications (AWS, Azure, GCP, CKA, CKAD, Terraform) ## Description We are seeking an AI DevOps Engineer to build, automate, and manage the infrastructure and deployment pipelines that support AI and machine learning applications. This role bridges DevOps, MLOps, and cloud engineering to ensure reliable, secure, and scalable delivery of AI solutions. The ideal candidate has expertise in cloud platforms, container orchestration, CI/CD, Infrastructure as Code (IaC), and observability, with experience supporting production AI and Generative AI workloads., * Design, implement, and maintain CI/CD pipelines for AI and machine learning applications. * Automate the deployment, scaling, and lifecycle management of AI services across cloud and hybrid environments. * Build and manage containerized AI workloads using Docker and Kubernetes. * Provision and manage infrastructure using Infrastructure as Code (Terraform, Pulumi, or CloudFormation). * Deploy and support AI/ML models in production using model serving frameworks and MLOps tools. * Monitor application health, infrastructure performance, model availability, and operational metrics. * Implement logging, tracing, and observability solutions for AI platforms. * Optimize cloud resources, GPU utilization, and infrastructure costs. * Integrate security best practices, secrets management, identity management, and compliance controls into AI deployment pipelines. * Collaborate with AI engineers, ML engineers, data engineers, platform engineers, and software development teams to streamline AI delivery. * Support automated testing, release management, rollback strategies, and disaster recovery for AI systems. * Troubleshoot production issues related to AI infrastructure, deployments, networking, and performance. * Continuously improve deployment automation, reliability, scalability, and operational efficiency.