> Markdown version of [/jobs/ext/2045134-ai-infrastructure-engineer](https://www.wearedevelopers.com/jobs/ext/2045134-ai-infrastructure-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Infrastructure Engineer - **Company:** AI CAPITAL LLC - **Location:** New York, NY, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Backup Devices, Databases, Continuous Integration, Relational Databases, Software Debugging, Distributed Systems, Python (Programming Language), Key Management, Software Deployment, Software Engineering, Data Streaming, Software Vulnerability Management, AI Infrastructure, Datadog, Load Balancing, Cloud Platform System, Large Language Models, Low Latency, Production Code, Api Gateway, Terraform, Docker, Programming Languages - **Published:** August 13, 2026 - **Apply:** https://www.careerjet.com/jobad/us06b0b10220efaafecea33dede94ae162 ## About the Role * 3+ years industrial experience in relevant technical domain. * Strong software engineering fundamentals and experience building or operating production distributed systems. * Hands-on experience with a major cloud platform; AWS experience is especially relevant. * Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging. * Ability to write reliable automation and services in Python or another modern programming language. * Sound judgment around availability, latency, scalability, security, and cost tradeoffs. * A track record of taking ambiguous operational problems from diagnosis through durable resolution. * Clear communication during architecture reviews, launches, and incidents. * AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems. ## Description Palona's AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience. We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle. Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching. What you will own: * Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications. * Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention. * Build deployment and release systems that make production changes fast, repeatable, auditable, and safe. * Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production. * Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities. * Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries. * Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity. * Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations. * Build internal tooling and paved paths that let engineers ship and operate services with less manual work. * Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment. ## Related Videos - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Debugging in the Dark](https://www.wearedevelopers.com/videos/1658-debugging-in-the-dark) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1146-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases) - [Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure](https://www.wearedevelopers.com/videos/1583-software-engineering-social-connection-yubo-s-lean-approach-to-scaling-an-80m-user-infrastructure) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)