> Markdown version of [/jobs/ext/1250944-ai-infrastructure-engineer](https://www.wearedevelopers.com/jobs/ext/1250944-ai-infrastructure-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Infrastructure Engineer - **Company:** Bright Vision Technologies - **Location:** Cobb, GA, United States (Remote available) - **Experience:** Expert - **Salary:** $100,000.0 - $150,000.0 - **Contract:** Permanent contract - **Skills:** Training Data, Artificial Intelligence, C++ (Programming Language), Computer Clusters, Code Review, Continuous Integration, Distributed Computing Environment, Fault Tolerance, Identity and Access Management, InfiniBand, Python (Programming Language), Linux Kernel, Machine Learning, Network Architecture, Open Source Technology, Remote Direct Memory Access, Runbook, Software Engineering, AI Infrastructure, Pytorch, AI Platforms, Kubernetes, Information Technology, Slurm, Machine Learning Operations, Data Pipelines - **Published:** July 12, 2026 - **Apply:** https://www.careerjet.com/jobad/usb7ee3105e13d268054b6fc83e0438f19 ## About the Role * Bachelor's or Master's degree in Computer Science or a related field. * Six or more years of experience in infrastructure, platform, or HPC engineering. * Hands-on experience operating GPU clusters or large-scale ML training infrastructure. * Strong proficiency in Python and at least one systems language such as Go or C++. * Deep understanding of distributed training, accelerator architectures, and collective communication. * Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads. * Strong understanding of Linux internals, networking, and high-performance storage. * Experience with at least one major cloud provider's ML infrastructure offerings. * Strong software engineering practices including testing, CI/CD, and code review. * Excellent communication and cross-functional collaboration skills. Preferred Qualifications * Experience operating InfiniBand or RDMA networking at scale. * Contributions to open-source ML infrastructure projects. * Familiarity with custom orchestrators or research-grade training stacks. * Exposure to frontier model training operations. * Experience with FinOps for AI workloads. ## Description This role is part of Bright Vision Technologies' in-house Statement of Work (SOW) engagement. The client, end customer, and employer for this position is Bright Vision Technologies - there is no third-party client, vendor, or implementation partner involved. We do not engage in C2C, 1099, or third-party arrangements for this role. BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE. Candidates must be willing to work directly as a full-time W2 employee of Bright Vision Technologies and contribute to our in-house SOW deliverables. No new H1B sponsorship is available for this role. However, candidates who are currently on a valid H1B visa and require a transfer are welcome to apply. We will support H1B transfers for qualified candidates. For every role, a technical coding assessment is mandatory. Please apply only if you are confident in your technical abilities and hands-on experience. Job Summary We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control. The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work., * Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations. * Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams. * Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering. * Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate. * Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication. * Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics. * Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale. * Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing. * Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently. * Partner with research and applied ML teams to plan capacity for upcoming training runs. * Implement security controls, isolation, and access management for multi-tenant AI infrastructure. * Drive automation across cluster provisioning, lifecycle management, and configuration enforcement. * Maintain runbooks, capacity dashboards, and operational documentation for the AI platform. * Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling. ## Related Videos - [Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬](https://www.wearedevelopers.com/videos/100355-running-secure-life-science-research-at-scale-using-hybrid-gpu-hpc-and-kubernetes) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Technical Documentation - How Can I Write Them Better and Why Should I Care?](https://www.wearedevelopers.com/videos/681-technical-documentation-how-can-i-write-them-better-and-why-should-i-care) - [Building the Nervous System of AI - Michael Kagan (NVIDIA)](https://www.wearedevelopers.com/videos/2133-building-the-nervous-system-of-ai-michael-kagan-nvidia) - [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)