AI DevOps Engineer
Spectraforce
Chicago, IL, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on leoforce.us
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source
Tech stack
AI Evaluation
Application Programming Interfaces (APIs)
Artificial Intelligence
Application Performance Management
Application Release Automation
Automation of Tests
Microsoft Azure
Bash Shell
Cloud Computing
Cloud Computing Security
Cloud Engineering
Configuration Management
+60 more
Software Quality
Code Review
Cyber Security
Linux
DevOps
Distributed Systems
Github
JSON
Python (Programming Language)
Key Management
Octopus Deploy
Performance Tuning
Windows PowerShell
Scrum Methodology
Systems Development Life Cycle
Regression Testing
Release Management
Reliability Engineering
OpenAI
Azure Machine Learning
Search Technologies
Software Deployment
Software Engineering
Management of Software Versions
YAML
Datadog
Policy as Code
Data Logging
Scripting
Cloud Platform System
Cloud Monitoring
Retrieval-Augmented Generation
Delivery Pipeline
Large Language Models
Snowflake
Generative AI
Agentic-AI
Git
Containerization
AI Platforms
Templating
Kubernetes
Information Technology
AgentOps
Bicep
Azure AKS
Machine Learning Operations
Drift Detection
Restful APIs
Terraform
Splunk
Software Version Control
Dynatrace
Devsecops
Api Management
Docker
Key Vault
Servicenow
Databricks
Microservices
Job description
- Design, build, and maintain CI/CD pipelines for AI applications, APIs, agents, orchestration services, infrastructure, prompts, configurations, and evaluation assets.
- Create reusable pipeline templates, quality gates, approval workflows, artifact controls, environment promotions, rollback patterns, and release evidence.
- Integrate automated testing across code quality, security, infrastructure, APIs, model and agent behavior, prompt regressions, and deployment smoke tests.
- Improve developer experience through standardized repositories, pipeline patterns, self-service automation, documentation, and policy-aware guardrails.
GenAIOps, AgentOps & AI Lifecycle:
- Operationalize Generative AI applications and agents across development, test, staging, and production environments.
- Implement repeatable processes for evaluation, versioning, deployment, monitoring, optimization, rollback, and retirement of AI-enabled solutions.
- Automate capture of relevant release metadata, including application version, model or endpoint configuration, prompt and agent configuration, evaluation results, approvals, and deployment history.
- Partner with AI Engineering and Product teams to define production-readiness criteria for RAG solutions, agentic workflows, Digital Coworkers, and shared AI services.
Cloud Platform & Infrastructure as Code:
- Design and maintain secure Microsoft Azure infrastructure using Terraform and approved Infrastructure as Code patterns.
- Build reusable modules and environment configurations for compute, containers, networking, identity, secrets, storage, observability, and AI platform services.
- Support containerized workloads and orchestration using Docker and Kubernetes platforms such as Azure Kubernetes Service.
- Apply configuration management, policy-as-code, drift detection, environment consistency, backup, recovery, and resilience practices.
DevSecOps, Governance & Controls:
- Embed security, privacy, compliance, and risk controls into the software and AI delivery lifecycle.
- Integrate source, dependency, container, infrastructure, secret, and policy scanning into automated pipelines, with documented exception and remediation paths.
- Implement least-privilege access, managed identity, secrets management, encryption, network controls, segregation of duties, and auditable approval processes.
- Maintain traceable deployment records, change evidence, technical documentation, and control artifacts required for internal governance and audit readiness.
Observability, Reliability & Operations:
- Implement end-to-end observability across infrastructure, applications, APIs, AI services, agents, RAG pipelines, and business workflows using logs, metrics, traces, dashboards, alerts, and service-level indicators.
- Monitor latency, availability, errors, throughput, capacity, token consumption, cost, model and agent quality signals, dependency health, and user-impacting failures.
- Support incident response, root-cause analysis, problem management, performance tuning, capacity planning, patching, release management, and production stability.
- Create and maintain runbooks, playbooks, support procedures, troubleshooting guides, recovery steps, and operational readiness checklists.
Collaboration & Engineering Leadership:
- Collaborate across AI Platform, Digital Coworkers, application delivery, Cloud, Cybersecurity, Architecture, Risk, Service Management, and vendor teams.
- Participate in architecture reviews, code reviews, design decisions, sprint planning, backlog refinement, release planning, and post-implementation reviews.
- Mentor engineers on DevOps, Infrastructure as Code, secure delivery, GenAIOps, observability, and production engineering practices.
- Identify opportunities to reduce manual work, improve controls, accelerate onboarding, increase reliability, and standardize delivery across AI use cases.
Requirements
- Bachelorβs degree in Computer Science, Engineering, Information Technology, or a related discipline, or equivalent practical experience.
- 7+ years of experience in DevOps, platform engineering, cloud engineering, site reliability engineering, software engineering, or a related discipline.
- 3+ years of hands-on experience building and supporting Microsoft Azure environments and production delivery pipelines.
- Strong experience with Azure DevOps and/or GitHub, including source control, pull requests, pipeline-as-code, artifact management, approvals, and release automation.
- Hands-on expertise with Terraform and reusable Infrastructure as Code modules; experience with Bicep or equivalent cloud-native templating is beneficial.
- Experience with Docker, Kubernetes, Linux, networking, identity, secrets management, and cloud security fundamentals.
- Proficiency in Python plus scripting with Bash, PowerShell, or a comparable language.
- Experience implementing monitoring, logging, tracing, alerting, dashboards, and production support practices for distributed systems.
- Demonstrated experience with secure SDLC, automated testing, change and release management, incident response, root-cause analysis, and operational documentation.
- Ability to communicate clearly with engineering, security, risk, operations, product, and business stakeholders in a regulated enterprise environment.
- Microsoft Azure; Microsoft Foundry / Azure AI services; Azure Machine Learning; Azure OpenAI; AKS; API Management; Key Vault; Entra ID; Azure Monitor
- Azure DevOps; Azure Boards; GitHub; GitHub Actions; Git; pull requests; pipeline-as-code; artifact repositories; release controls
- Terraform; Bicep; Docker; Kubernetes; Helm; Linux; networking; configuration and policy-as-code
- AI application and agent evaluation; prompt and configuration versioning; RAG quality; model and endpoint operations; regression testing; safety and approval gates
- OpenTelemetry; logs; metrics; traces; dashboards; alerting; SLI/SLO practices; incident response; root-cause analysis; capacity and cost monitoring
- Python; Bash; PowerShell; REST APIs; JSON/YAML; microservices; event-driven integration; Snowflake/Databricks familiarity
- DevSecOps scanning; secrets management; identity and access controls; encryption; ServiceNow; change/release/problem management; audit evidence
Nice to Haves:
- Experience deploying and operating Generative AI applications, LLM-powered services, AI agents, RAG solutions, vector search, or shared enterprise AI platforms.
- Knowledge of GenAIOps, MLOps, AgentOps, model and endpoint lifecycle management, prompt and agent versioning, AI evaluation, and AI observability.
- Experience with Microsoft Foundry or Microsoft Azure AI services, Azure Machine Learning, Azure OpenAI, API Management, Key Vault, Entra ID, Azure Monitor, and Azure Kubernetes Service.
- Experience with AI application evaluation, safety testing, content controls, red-team support, human approval gates, and responsible AI governance.
- Experience with OpenTelemetry and enterprise observability platforms such as Azure Monitor, Application Insights, Datadog, Dynatrace, Splunk, or equivalent.
- Experience with GitOps and deployment tooling such as Argo CD, Helm, or equivalent patterns.
- Experience with ServiceNow and enterprise incident, change, problem, request, and configuration-management processes.
- Experience in financial services or another highly regulated industry.
- Relevant certifications such as Microsoft Azure, GitHub, Kubernetes, Terraform, DevOps, MLOps, or AI engineering credentials.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on leoforce.us
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦