Software Engineer - AI Infrastructure

We are seeking a highly skilled and motivated Senior Software Engineer to play a key role in the design and implementation of our on-premise Compute as a Service (CaaS) and GPU as a Service (GPUaaS) offerings. You will be instrumental in building a robust and scalable infrastructure platform, enabling our engineering teams to efficiently deploy and manage applications. Additionally, you will contribute to the design and development of a cloud-integrated marketplace for seamless application deployment onto our on-premise bare metal Kubernetes clusters. This role requires a strong understanding of cloud-native technologies, bare metal infrastructure, and marketplace design principles., * Contribute to the architectural design and implementation of a scalable and efficient CaaS and GPUaaS platform on our on-premise bare metal clusters.

• Implement and integrate key technologies for our stack, including hypervisors (e.g., KVM), container runtimes (Docker, containerd), orchestration platforms (Kubernetes), and GPU virtualization technologies (Kubevirt, vGPU).
• Develop and implement robust monitoring, logging, and alerting systems for the CaaS and GPUaaS platform.
• Optimize performance and resource utilization of the bare metal infrastructure.

Marketplace Development:

• Contribute to the design and development of a cloud-integrated marketplace for deploying applications onto the on-premise infrastructure.
• Implement backend services and API integrations for the marketplace.
• Develop secure and efficient application deployment workflows.
• Integrate the marketplace with existing cloud services and infrastructure.
• Develop and maintain comprehensive documentation for the marketplace.

Technical Contribution:

• Write clean, well-tested, and maintainable code.
• Participate in technical design and code reviews.
• Stay up-to-date with the latest industry trends and technologies.
• Collaborate with cross-functional teams, including engineering, operations, and product management.

• ship Required
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 6+ years of experience in infrastructure engineering or software development.
• Proven experience in designing and implementing CaaS and/or GPUaaS platforms.
• Strong understanding of containerization technologies (Docker, Kubernetes).
• Experience with bare metal infrastructure and hardware management.
• Experience with cloud platforms (AWS, Azure, Google Cloud Platform).
• Experience designing and implementing marketplaces or similar platforms.
• Strong programming skills in languages such as Python, Go, or Java.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills.
• Experience with infrastructure as code tools (Terraform, Ansible)., * Experience with high-performance computing (HPC) environments.
• Experience with GPU virtualization and management.
• Experience with distributed storage systems.
• Experience with security best practices in cloud and on premise environments.
• Experience with building CI/CD pipelines., * A go-getter with a growth mindset. You’re intellectually curious, have strong business acumen, and actively seek opportunities to build relevant skills and knowledge
• A detail-oriented problem-solver. You can independently gather information, solve problems efficiently, and deliver results with a “get-it-done” attitude
• Thrive in a fast-paced environment. You’re energized by an entrepreneurial spirit, capable of working quickly, and excited to contribute to a growing company
• A collaborative team player. You focus on business success and are motivated by team accomplishment vs personal agenda
• Highly organized and results-driven. Strong prioritization skills and a dedicated work ethic are essential for you

For U.S. Based candidates: To ensure fairness and transparency, the starting base salary range for this role for candidates in the U.S. are listed below, varying based on location experience, skills, and qualifications. In addition to base salary, this role will also be offered equity and subsidized benefits (details available upon request).

• Medical, dental, and vision (subsidized cost)
• Health savings accounts (HSA), flexible spending accounts (FSA), and dependent care FSAs (DCFSA)
• Retirement plan options, including 401(k) and Roth 401(k)
• Unlimited paid time off (PTO)
• 14 paid company holidays per year, $157,600-$197,000 USD

Armada is the hyperscaler for the edge, delivering modular AI infrastructure from first deployment to AI factory with speed, scale and sovereignty. Named one of Fast Company’s Most Innovative Companies and to the CNBC Disruptor 50, Armada’s solutions are deployed in over 60 countries globally for organizations ranging from energy to defense.

With nearly $500 million in funding to date, Armada is backed by leading investors including Founders Fund, Lux, BlackRock and Microsoft (M12), alongside strategic partnerships with Microsoft, Dell, Palantir, NVIDIA, SpaceX, and Skydio. We are building the infrastructure layer for sovereign and edge AI - rugged, deployable compute for customers that cannot rely on centralized cloud.

Working at Armada means taking ownership, driving autonomy, and delivering impact. You’ll tackle challenges that haven’t been solved before and help build something transformative from the ground up. What you do here will not only define your career but help further Armada’s mission to bridge the digital divide for customers around the world.