AI Systems Performance Specialist

Bright Vision Technologies
Apex, NC, United States
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$130,000.0 - $180,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure C++ (Programming Language) Profiling Nvidia CUDA Information Systems Computer Programming Computer Engineering Distributed Computing Environment Distributed Systems Memory Management
+18 more
Python (Programming Language) Open Source Technology Performance Tuning Regression Testing AI Infrastructure Google Cloud High Performance Computing Pytorch Large Language Models Deep Learning Information Technology Low Latency Optimization Algorithms Hardware Acceleration Machine Learning Operations TensorRT Cloud Optimization Decoding

Job description

Bright Vision Technologies is seeking a highly experienced AI Systems Performance Specialist with 10+ years of experience in AI infrastructure, machine learning systems, High-Performance Computing (HPC), and performance engineering. The ideal candidate will optimize AI training and inference workloads for maximum performance, scalability, reliability, and cost efficiency. This role requires deep expertise in GPU optimization, distributed training, Large Language Model (LLM) inference, Python, C++, CUDA, and production AI systems, along with the ability to lead performance optimization initiatives across enterprise-scale AI platforms., * Optimize AI training and inference pipelines for maximum throughput, low latency, scalability, and infrastructure efficiency.

  • Analyze and improve GPU utilization, memory management, kernel execution, and multi-GPU performance across production AI workloads.
  • Design and implement optimization techniques including quantization, pruning, mixed precision, batching, caching, speculative decoding, and model parallelism.
  • Profile AI applications using industry-standard performance analysis tools and identify bottlenecks across compute, memory, networking, and storage.
  • Optimize distributed training and inference using NCCL, DeepSpeed, PyTorch Distributed, Ray, MPI, or similar distributed computing frameworks.
  • Collaborate with AI researchers, ML engineers, platform engineers, and infrastructure teams to improve model performance and production reliability.
  • Build automated benchmarking frameworks, performance dashboards, monitoring solutions, and regression testing pipelines.
  • Evaluate emerging AI hardware, GPU architectures, inference frameworks, and optimization technologies to improve enterprise AI capabilities.
  • Drive AI infrastructure cost optimization through efficient resource utilization, cloud optimization, and FinOps best practices.
  • Mentor engineering teams and provide technical leadership on AI systems architecture, GPU optimization, and performance engineering., Description: ABOUT THE POSITION Collections Specialist is responsible for proactively managing delinquent accounts by contacting Credit Union members. This role involves identi…
  • 1 day ago, Overview: The Pharmacy Financial Systems Specialist for procurement assists pharmacy management by maintaining information systems that support financial, operational and procureme…
  • 1 month ago, Job Description: Overview The Pharmacy Financial Systems Specialist for procurement assists pharmacy management by maintaining information systems that support financial, opera…
  • 1 month ago +

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, Artificial Intelligence, or a related technical discipline.
  • 10+ years of professional experience in performance engineering, AI infrastructure, machine learning systems, High-Performance Computing (HPC), or distributed computing.
  • Expert-level programming skills in Python and C++.
  • Extensive experience optimizing GPU-accelerated AI workloads using CUDA, distributed training frameworks, and modern deep learning libraries.
  • Strong knowledge of Large Language Models (LLMs), deep learning frameworks, model serving, and production AI inference.
  • Hands-on experience with profiling tools such as NVIDIA Nsight Systems, Nsight Compute, PyTorch Profiler, TensorBoard, or similar performance analysis tools.
  • Experience deploying and optimizing AI workloads on AWS, Microsoft Azure, or Google Cloud Platform (GCP).
  • Strong understanding of distributed systems, networking, storage optimization, and AI infrastructure architecture.
  • Excellent analytical, troubleshooting, communication, and technical leadership skills.

Preferred Qualifications

  • Experience optimizing production-scale LLM inference and serving large foundation models.
  • Hands-on experience with vLLM, TensorRT-LLM, DeepSpeed, Triton Inference Server, CUTLASS, FasterTransformer, or similar AI optimization frameworks.
  • Knowledge of model compression, KV cache optimization, speculative decoding, and advanced inference optimization techniques.
  • Experience implementing FinOps strategies for AI infrastructure cost optimization and resource management.
  • Contributions to AI systems research, open-source AI infrastructure projects, patents, or technical publications.
  • Familiarity with emerging AI accelerator technologies, including AMD ROCm, Intel oneAPI, or custom AI hardware.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · WWC Europe 2026

4:52 min

Essential phases in building and refining language models

Anshul Jindal Anshul Jindal +1 · WWC 2025

2:23 min

Evaluating video encoding formats for faster decoding

Magne Johansen Magne Johansen · Europe 2026 Virtual

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · WWC 2023

5:07 min

Leveraging specialized AI frameworks and accelerated libraries

Paul Graham Paul Graham · WWC 2024

2:32 min

Core libraries driving inference engines and multi-GPU networking

Adolf Hohl Adolf Hohl · WWC 2024

Videos

See all

Related articles

See all