Erik Koci

Bridging AI and Nomad: a Go-based MCP Server for Cluster Control

What if an AI could troubleshoot a failed deployment faster than you? See how a new MCP server connects an LLM directly to your Nomad cluster.

Bridging AI and Nomad: a Go-based MCP Server for Cluster Control
#1about 2 minutes

Understanding HashiCorp Nomad for orchestration

Nomad provides a simple, flexible, and scalable alternative to Kubernetes for running diverse workloads like containers, VMs, and batch jobs.

#2about 2 minutes

Introducing the MCP standard for AI tools

The Model-Controller-Periphery (MCP) protocol provides a unified, open standard for AI models to interact with external tools and APIs.

#3about 1 minute

Differentiating between LLM skills and MCP tools

LLM skills act as instruction playbooks that guide an AI's workflow, while MCP provides the action-oriented tools that execute API calls.

#4about 3 minutes

Using natural language to simplify cluster management

An MCP server for Nomad reduces context switching and cognitive load for on-call engineers by enabling cluster operations through natural language prompts.

#5about 2 minutes

Building the MCP server for Nomad in Go

The server implements over 50 tools covering the full Nomad API and supports multiple transport protocols like STDIO, SSE, and HTTP streaming.

#6about 2 minutes

Securing a Nomad cluster controlled by an AI

Security is enforced by reusing Nomad's existing ACL token system, supplemented with an API path allowlist, origin validation, and connection timeouts.

#7about 2 minutes

Design choices and trade-offs for the MCP server

The server benefits from separate interfaces and a single binary deployment, but faces trade-offs like increased latency with more tools and reliance on Nomad's ACLs.

#8about 10 minutes

Live demo of AI-driven Nomad cluster operations

The demo showcases using natural language to list jobs, drain nodes for maintenance, scale services, and troubleshoot a failed WordPress deployment.

#9about 2 minutes

Lessons learned from building AI-integrated tools

Effective AI tool integration requires clear descriptions, a minimal set of essential tools, strict permissioning, and a simple installation process.

Related jobs
Jobs that call for the skills explored in this talk.

Featured Partners

Related Articles

View all articles

From learning to earning

Jobs that call for the skills explored in this talk.