> Markdown version of [/jobs/ext/4451831-principal-ai-systems-engineer-highrise-ai](https://www.wearedevelopers.com/jobs/ext/4451831-principal-ai-systems-engineer-highrise-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal AI Systems Engineer - Highrise AI - **Company:** HIGH RISES, LLC - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Proxmox, Active Directory, Artificial Intelligence, Amazon S3, User Authentication, Bash Shell, Big Data, Cloud Computing, Configuration Management, Cyber Security, Data Centers, Dynamic Host Configuration Protocol, Data Center Infrastructure Management (CIM), Linux, Disaster Recovery, Distributed Data Store, Distributed Systems, Domain Name System (DNS), Failover, Firmware, Identity and Access Management, Python (Programming Language), Kernel-Based Virtual Machine, Lightweight Directory Access Protocols (LDAP), Linux System Administration, Network Time Protocols, OpenID, Performance Tuning, Role-Based Access Control, Ansible, Security Assertion Markup Language (SAML), Single Sign-On, Software Engineering, Virtualization Technology, Weka, AI Infrastructure, Data Logging, System Availability, Firewalls (Computer Science), Integration Tests, Infrastructure Automation Frameworks, Information Technology, Hardware Infrastructure, 3-tier Architectures, Terraform, Network Server, Block Storage, Vulnerability Analysis, Vmware - **Published:** October 15, 2026 - **Apply:** https://www.builtincolorado.com/job/principal-ai-systems-engineer-highrise-ai/11730124?handler=ApplyRedirect ## About the Role * Bachelor's degree in computer science, engineering, information technology, or related discipline, or equivalent practical experience. * 10+ years of hands-on experience engineering and operating enterprise, cloud, HPC, or large-scale data center infrastructure. * Expert-level Linux systems administration, troubleshooting, automation, and infrastructure integration experience. * Strong experience with enterprise x86 platforms, virtualization technologies, and automated provisioning solutions. * Hands-on experience deploying and supporting high-performance or distributed storage platforms, preferably WEKA or VAST Data. * Strong understanding of DNS, DHCP, IPAM, identity management, SSO, RBAC, and core infrastructure services. * Experience with infrastructure automation using Python, Bash, Ansible, Terraform, or equivalent technologies. * Familiarity with security infrastructure, compliance requirements, monitoring, and enterprise authentication systems. * Experience supporting AI/HPC clusters, GPU infrastructure, or large-scale distributed computing environments is highly desirable. Core Competencies * Expert-level troubleshooting and problem-solving across hardware, operating systems, virtualization, storage, and infrastructure services. * Strong ownership of deployment outcomes, operational reliability, system performance, and technical documentation. * Ability to independently design and implement complex infrastructure solutions while collaborating with senior engineering peers. * Highly analytical, detail-oriented, and comfortable operating in fast-paced, mission-critical environments. * Excellent written and verbal communication skills with engineering leadership, vendors, and operational stakeholders. * Continuous improvement mindset with a strong emphasis on automation, standardization, and operational efficiency. ABOUT THE WORK ENVIRONMENT This is a full-time, engineering role supporting large-scale AI compute infrastructure across multiple sites. Travel to data centers for cluster commissioning, acceptance, and complex troubleshooting will be required. Flexibility to assist with critical incidents or maintenance activities outside regular business hours is expected. This role is hybrid or remote depending on location. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. ## Description We are seeking a principal-level, hands-on AI Systems Engineer to design, deploy, integrate, and operate the supporting infrastructure required for large-scale AI compute clusters. Working alongside senior compute, networking, and infrastructure engineers, this person will lead the deployment and configuration of general-purpose compute, virtualization, high-performance storage, infrastructure services, identity management, and security platforms. The engineer will be responsible for bringing these systems from initial installation through integration, validation, and production acceptance. Following deployment, this person will provide Tier 3 technical escalation, advanced troubleshooting, and ongoing optimization of production infrastructure., Systems Infrastructure Deployment and Integration * Lead deployment and configuration of general-purpose x86 servers, Linux operating systems, virtualization platforms, and supporting infrastructure services. * Design, deploy, and manage virtualized infrastructure using VMware, KVM, Proxmox, or equivalent technologies. * Implement and maintain automated bare-metal provisioning, imaging, firmware management, and configuration workflows. * Deploy and integrate core infrastructure services, including DNS, DHCP, NTP, IPAM, and DCIM platforms such as Infoblox and NetBox. * Establish standardized configurations, infrastructure baselines, and scalable deployment procedures across multiple AI cluster environments. Storage Infrastructure and Performance * Deploy, configure, and optimize high-performance storage platforms, including WEKA, VAST Data, and other distributed storage solutions. * Implement and manage file, object, and block storage services, including NFS and S3-compatible interfaces. * Validate storage availability, performance, capacity, resilience, and integration with GPU compute environments. * Troubleshoot storage performance bottlenecks, connectivity issues, filesystem errors, and distributed storage failures. * Coordinate with storage vendors and engineering teams on deployment, acceptance testing, upgrades, and performance optimization. Identity, Security, and Infrastructure Automation * Deploy and maintain identity and access management services, including Active Directory/LDAP, SSO, SAML/OIDC, and role-based access control (RBAC). * Integrate security and compliance infrastructure, including firewalls, access gateways, vulnerability scanning, logging, and audit systems. * Implement automated provisioning, configuration management, and infrastructure-as-code solutions using Ansible, Terraform, Python, or equivalent tools. * Establish secure administrative access, authentication, authorization, and privileged access management across infrastructure platforms. * Partner with security and compliance teams to implement infrastructure controls, system hardening, access policies, and audit requirements. Systems Validation and Production Acceptance * Lead integration testing and operational acceptance of supporting infrastructure prior to commercial cluster deployment. * Validate system availability, redundancy, failover, service dependencies, performance, and recovery procedures. * Identify and remediate configuration inconsistencies, integration issues, and infrastructure reliability risks. * Develop acceptance criteria, testing procedures, operational documentation, and production handoff requirements. Tier 3 Operations and Reliability * Serve as a senior technical escalation point for complex production incidents involving systems, virtualization, storage, identity, and infrastructure services. * Perform advanced troubleshooting, root cause analysis, and corrective action planning for recurring or systemic failures. * Support infrastructure upgrades, maintenance, capacity expansion, and lifecycle management with appropriate change controls. * Develop diagnostic tooling, automation, operational runbooks, and monitoring standards to improve reliability and reduce operational overhead. * Collaborate with NOC, SRE, data hall technicians, engineering teams, and external vendors to resolve critical infrastructure issues.