AI Infrastructure Engineer
JOSEF GROUP INC
Chantilly, VA, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$200,000 - $250,000
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Proxy Servers
User Authentication
Bash Shell
Nvidia CUDA
Memory Management
Monitoring of Systems
Python (Programming Language)
Linux System Administration
Prometheus
AI Infrastructure
Qdrant
+16 more
Graphics Processing Unit (GPU)
Transport Layer Security
Load Balancing
Large Language Models
Grafana
Generative AI
Rate Limiting
Discretization
Pgvector
Containerization
Kubernetes
Weaviate
LiteLLM
Hardware Infrastructure
Terraform
Docker
Job description
- Containerize AI workloads using Docker and orchestrate production environments with Kubernetes, including GPU scheduling.
- Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting.
- Optimize GPU utilization, memory management, quantization, batching, and capacity planning to balance performance and cost.
- Develop and maintain CI/CD pipelines, observability, monitoring, and incident response processes.
Requirements
Artificial Intelligence (AI), Production Systems, Docker, Artificial Intelligence (AI), GPU (Graphics Processing Unit), Load Balancing, SSL-TLS (Secure Socket Layer - Transport Layer Security), Authentication, Traffic Shaping, Memory Management, * Hands-on experience deploying and serving Large Language Models (LLMs) in production.
- Strong experience with Docker and production Kubernetes environments, including GPU scheduling.
- Deep understanding of self-hosted AI infrastructure, including model formats, quantization, GPU memory management, batching, and inference optimization.
- Experience supporting production applications with networking, reverse proxies, load balancing, authentication, and TLS.
- Proficiency with Linux administration and Python and/or Bash scripting.
- Ownership mindset with the ability to operate and improve production AI infrastructure., * Experience with CUDA, NVIDIA drivers, GPU Operators, or other GPU infrastructure technologies.
- Experience with Infrastructure as Code (Terraform, Helm).
- Familiarity with observability and monitoring tools such as Prometheus and Grafana.
- Experience building Retrieval-Augmented Generation (RAG) pipelines and working with vector databases (pgvector, Qdrant, Weaviate).
- Experience with LLM gateway tools such as LiteLLM.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦