AI Infrastructure Engineer

• Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads
• Own datacenter and infrastructure operations: compute, storage, networking, and the automation layered on top
• Build and maintain Infrastructure-as-Code using Terraform (Terragrunt), Ansible, etc.
• Deploy, secure, and operate our HashiCorp stack (Vault, Boundary) alongside identity/access via Keycloak
• Build and maintain observability with Prometheus, Grafana, and Alertmanager
• Deploy and manage containerized workloads via Docker and Kubernetes
• Design and maintain networking infrastructure: VLANs, routing, firewall rules, and load balancers
• Write scripts/tools (and contribute code where useful) to automate operational toil
• Provide general datacenter support for customers colocated in the HostMax datacenter - things like cabling, hardware swaps, rack/stack work, and basic troubleshooting
• Participate in business-hours (M-F) on-call rotation for customer and infrastructure support
• Participate in an SDLC/Scrum-based workflow, using Jira and Confluence for planning and documentation
• Help define standards, runbooks, and best practices as the team grows
• Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving infra, self-hosted AI tooling, etc.)

• Solid experience with Infrastructure-as-Code and Configuration-as-Code
• Real-world on-prem/datacenter operations experience - this is explicitly not a cloud-native (AWS/GCP/Azure) role, though the environment is designed to feel cloud-like
• Working knowledge of networking fundamentals: VLANs, routing, firewalls, and load balancers
• Hands-on experience with containerization and orchestration (Docker, Kubernetes)
• Proficiency with Git and standard version control workflows
• Development/scripting skills sufficient to build internal tooling and automation (not just run existing playbooks)
• Comfort with hands-on datacenter/hardware work (cabling, rack/stack, hardware troubleshooting) in addition to infra engineering

• Medical Insurance
• Dental Insurance
• Vision Insurance
• 401(k)
• Flexible spending account
• Commuter benefits
• Disability insurance

We also have a perfect location for all types of commuters: AMAX is located right between I-680 and I-880. Warm Springs/South Fremont BART station and bus stops are within a 10-minute walking distance. 5 grocery stores, 6+ coffee/tea places, and numerous restaurants within 1 mile. Feel free to try the delicious fusions or grab your daily groceries after work!