> Markdown version of [/jobs/ext/1283511-ai-infrastructure-engineer](https://www.wearedevelopers.com/jobs/ext/1283511-ai-infrastructure-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Infrastructure Engineer

- **Company:** Amax, Inc.
- **Location:** Fremont, CA, United States
- **Salary:** $145,000.0 - $170,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Data Centers, Networking Basics, Routing, Scrum Methodology, Systems Development Life Cycle, Ansible, Prometheus, Virtual Local Area Networks, AI Infrastructure, Scripting, Computer Networking Systems, Load Balancing, Okta, Grafana, Firewalls (Computer Science), Git, Containerization, Kubernetes, Atlassian Tools, Hashicorp, Hardware Infrastructure, Firewall Services Module, Terraform, Software Version Control, Docker
- **Published:** July 15, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=c950cd6ca68309f0

## About the Role

* Solid experience with Infrastructure-as-Code and Configuration-as-Code
 * Real-world on-prem/datacenter operations experience - this is explicitly not a cloud-native (AWS/GCP/Azure) role, though the environment is designed to feel cloud-like
 * Working knowledge of networking fundamentals: VLANs, routing, firewalls, and load balancers
 * Hands-on experience with containerization and orchestration (Docker, Kubernetes)
 * Proficiency with Git and standard version control workflows
 * Development/scripting skills sufficient to build internal tooling and automation (not just run existing playbooks)
 * Comfort with hands-on datacenter/hardware work (cabling, rack/stack, hardware troubleshooting) in addition to infra engineering

## Description

* Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads
 * Own datacenter and infrastructure operations: compute, storage, networking, and the automation layered on top
 * Build and maintain Infrastructure-as-Code using Terraform (Terragrunt), Ansible, etc.
 * Deploy, secure, and operate our HashiCorp stack (Vault, Boundary) alongside identity/access via Keycloak
 * Build and maintain observability with Prometheus, Grafana, and Alertmanager
 * Deploy and manage containerized workloads via Docker and Kubernetes
 * Design and maintain networking infrastructure: VLANs, routing, firewall rules, and load balancers
 * Write scripts/tools (and contribute code where useful) to automate operational toil
 * Provide general datacenter support for customers colocated in the HostMax datacenter - things like cabling, hardware swaps, rack/stack work, and basic troubleshooting
 * Participate in business-hours (M-F) on-call rotation for customer and infrastructure support
 * Participate in an SDLC/Scrum-based workflow, using Jira and Confluence for planning and documentation
 * Help define standards, runbooks, and best practices as the team grows
 * Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving infra, self-hosted AI tooling, etc.)


## Related Videos

- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Infrastructure as Prompts: Creating Azure Infrastructure with AI Agents](https://www.wearedevelopers.com/videos/1533-infrastructure-as-prompts-creating-azure-infrastructure-with-ai-agents)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)
- [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)