AI DevOps Engineer
Role details
Job location
Tech stack
Job description
- CI/CD Pipelines: Design and build Git-based pipelines that automate build * test * deploy for Retool apps, agentic workflows, MCP servers, and data connectors - turning manual client deployments into repeatable, gated releases.
- Infrastructure as Code: Make the platform reproducible. Use Terraform, Helm, and GitOps (ArgoCD/Flux) to provision and manage Kubernetes (Nutanix NKP) clusters and per-client environments as code.
- Configuration Management: Manage environment and deployment configuration as code across a growing fleet of client deployments - eliminate config drift and one-off manual changes.
- Release Management: Own versioning, environment promotion, release gates, and clean rollback. Maintain versioned, deployable artifacts so any release can be reproduced or reverted.
- Observability & Tracing: Build the monitoring backbone - Elastic/ECK, APM, and telemetry distributed tracing - with deployment health, SLOs/SLIs, and usage/cost instrumentation across all client deployments. Strengthen alerting so issues surface before clients feel them.
- LLMOps Practices: Stand up prompt and configuration versioning, model/prompt evaluation pipelines, A/B testing of prompts and models, multi-provider traffic routing and failover, and token/cost dashboards - the AI-specific discipline that keeps model-powered systems accurate, available, and affordable.
- Change & Risk Management (incl. Compliance): Implement controlled-change processes - approvals, audit trails, and guardrails - with compliance-as-code for SOC 2 audit logging, secrets management (e.g., vaults/sealed-secrets), and SSO/OIDC configuration.
- Automation Marketplace: Build an internal library of vetted, reusable workflows, connectors, and IaC modules that accelerate client delivery - and graduate proven items into a client-facing catalog aligned to the Agentic Workflow Engine (AWE).
- Collaborate & Document: Partner with the AI Dev engineering team on platform standards; write the runbooks, release guides, and architecture docs that let the framework scale beyond, What state do you live in? Do you have reliable transportation for this hybrid position?* Are you currently, or have you ever been employed by Expedient?* Do you currently have a non-compete/non-disclosure agreement with your existing or former employer?* Do you need, or will you need in the future, any immigration related support or sponsorship from Expedient in order to begin or continue employment with Expedient? This includes support (such as J-1, F-1 CPT letter, OPT, STEM OPT Training Plan) and visa sponsorship for employment (H-1B, H-1B1, E-3, O-1, or TN).* The following questions are entirely optional. To comply with government Equal Employment Opportunity and/or Affirmative Action reporting regulations, we are requesting (but NOT requiring) that you enter this personal data. This information will not be used in connection with any employment decisions, and will be used solely as permitted by state and federal law. Your voluntary cooperation would be appreciated. Learn more. Gender Race/Ethnicity
Requirements
- Experience: 3-5 years in DevOps, platform engineering, site reliability, or MLOps/LLMOps. Prior experience at a managed service provider, SaaS company, or enterprise technology team is a strong plus.
- Git-based CI/CD: designing automated build/test/deploy pipelines from scratc
- Infrastructure as Code: Terraform and Helm; GitOps with ArgoCD or Flu
- Kubernetes: operating and automating clusters (Nutanix NKP or equivalent); namespaces, workloads, container lifecycle
- Observability: Elastic/ECK, APM, OpenTelemetry tracing; defining alerts, SLOs/SLIs (Prometheus/Grafana experience transfers)
- Scripting & data: strong Python and Bash; SQL fundamentals
- Secrets & identity: secrets management (Vault or equivalent), SSO/OIDC configuration (Entra ID, Okta, OneLogin)
- Workflow orchestration: Argo Workflows, Airflow, or similar (a plus)
- LLM APIs: working familiarity with Anthropic Claude, OpenAI, and/or Google Gemini - prompt construction, tool use/function calling, token management
- RAG & MCP awareness: chunking, embedding, vector search, context-window management; Model Context Protocol integrations (a plus)
- Compliance exposure: SOC 2 audit logging and controls-as-code (a plus)
- Builder mindset: sees a manual process and automates it; ships the framework, not just the fix
- Automation-first & reliability-minded: treats infrastructure, config, and compliance as code; thinks in SLOs, blast radius, and rollback
- Documentation instinct: writes the runbook before calling something done; updates the guide when the process changes
- Risk-aware: balances deployment velocity with controlled change and auditability
- Self-directed, strong ownership mentality, excellent communicator, thrives in a fast-paced environment
- Education: Bachelor's in Computer Science, Engineering, Information Systems, or related field (or equivalent practical experience).
Benefits & conditions
Salary for this position is directly related to your own experience, knowledge, and skills. Estimated range for this role is $120,000 to $150,000
#LI-hybrid
WORKING FOR EXPEDIENT We prioritize ongoing education and continuous innovation to remain at the forefront of the information technology landscape. Our commitment to learning is reflected in our comprehensive employee training and tuition reimbursement programs, which are driven by our employees and funded by Expedient 100%.
For our full-time employees we offer an exceptional benefits package including three weeks of paid time off annually that increases with tenure plus your birthday off and a health holiday to be used for preventive care. We offer parental leave, top-tier medical, dental, and vision, disability and life insurance, at an affordable rate, wellness engagement opportunities, and a 401(k) with a generous match.
We also recognize the importance of a comfortable and convenient work environment. We offer a hybrid work model for many roles, paid parking and other perks.