> Markdown version of [/jobs/ext/2604407-software-engineer-infrastructure](https://www.wearedevelopers.com/jobs/ext/2604407-software-engineer-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer, Infrastructure - **Company:** GRAY, INC - **Location:** United States - **Experience:** Expert - **Salary:** $180,000.0 - $290,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Microsoft Azure, C++ (Programming Language), Cloud Computing, Cloud Computing Security, Cloud Engineering, Computer Programming, Software Debugging, Distributed Data Store, Distributed Systems, Python (Programming Language), PostgreSQL, Machine Learning, Redis, Zero Trust Network Access, Software Safety, Rust (Programming Language), Data Logging, Large Language Models, Reliability of Systems, Backend, Event Driven Architecture, Kubernetes, Infrastructure Automation Frameworks, Apache Kafka, Vertica, Golang, Microservices - **Published:** August 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=91e8df3f654f2022 ## About the Role * 5+ years of experience building backend infrastructure or distributed systems in production environments. * Strong programming skills in C/C++, Go, Python, Rust, or Java. * Experience operating services on Kubernetes and modern cloud platforms such as AWS, GCP, or Azure. * Deep understanding of networking, distributed systems, containers, service orchestration, and scalable architectures. * Experience designing APIs, microservices, asynchronous systems, and event-driven architectures. * Comfortable debugging complex production issues and improving reliability through automation and operational excellence. * Passionate about writing clean, maintainable code and building infrastructure that other engineers love using. * Excited to work in a fast-moving startup with significant ownership and ambiguity. Bonus Points If You Have: * Experience supporting machine learning or LLM infrastructure. * Familiarity with infrastructure-as-code tools. * Experience with Kafka, Redis, PostgreSQL, ClickHouse, or similar distributed data systems. * Experience building internal developer platforms or platform engineering tooling. * Knowledge of cloud security, infrastructure hardening, or zero-trust architectures. * Previous experience at a high-growth startup or building products from zero to one. * Interest in AI safety, cybersecurity, or adversarial machine learning. If you don't have 100% of these, you should still seriously consider applying. We care more about what you can do than your credentials. You'll Thrive Here If You: * You thrive on ownership and solving hard problems. You're energized by ambiguity, enjoy building systems from the ground up, and take pride in delivering reliable solutions from design through production. * You think at scale. You enjoy designing resilient infrastructure, optimizing performance, and building systems that are secure, observable, and built to grow. * You collaborate across disciplines. You work effectively with machine learning engineers, security researchers, and product teams, knowing that the best infrastructure enables everyone else to move faster. * You're excited by our mission and startup environment. You enjoy moving quickly, adapting to change, and helping build the foundation for the future of secure AI., Technical interview (90 min). Live coding with some tasks requiring AIand others not. Experience & culture interview (60 min). Conversational exploration of the skills fit. Reference checks. We'll reach out to 3-5 references that you provide. ## Description Gray Swan is looking for an Infrastructure Engineer to build and scale the systems that power our AI security platform. You'll design the backend services, distributed infrastructure, and cloud architecture that enable Gray Swan to build AI systems and for customers to safely deploy frontier AI models at scale. This role is ideal for an engineer who enjoys solving infrastructure challenges across reliability, scalability, observability, and performance. You'll work closely with machine learning engineers, product engineers, and security researchers to ensure our platform remains fast, resilient, and secure as we grow. You'll have significant ownership over foundational systems and the opportunity to influence technical direction in a rapidly evolving AI startup. What You'll Do: * Design, build, and maintain highly available backend services and distributed systems that power Gray Swan's AI security platform. * Own cloud infrastructure across Kubernetes, AWS, networking, storage, and compute to ensure reliable production environments. * Build scalable APIs, internal platform services, and infrastructure tooling that improve developer productivity and system reliability. * Improve system observability through logging, metrics, tracing, dashboards, and automated alerting. * Optimize performance, latency, and infrastructure costs while maintaining reliability and security. * Partner closely with machine learning, security, and product engineering teams to deliver production-ready infrastructure for AI workloads. ## Related Videos - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall) - [Slopquatting, API Keys, Fun with Fonts, Recruiters vs AI and more - The Best of LIVE 2025 - Part 2](https://www.wearedevelopers.com/videos/1765-slopquatting-api-keys-fun-with-fonts-recruiters-vs-ai-and-more-the-best-of-live-2025-part-2) - [Accelerating Authentication Architecture: Taking Passwordless to the Next Level](https://www.wearedevelopers.com/videos/733-accelerating-authentication-architecture-taking-passwordless-to-the-next-level) - [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang) ## Related Articles - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [How to Answer the Interview Question: “Why Do You Want to Be a Software Engineer?”](https://www.wearedevelopers.com/magazine/392-how-to-answer-the-interview-question-why-do-you-want-to-be-a-software-engineer)