SR GEN AI Engineer

Quantum Technologies
Ford Heights, IL, United States
4 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$180,960
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Bioinformatics C++ (Programming Language) Profiling Computer Programming Continuous Integration Software Design Documents Distributed Systems General-Purpose Computing on Graphics Processing Units Python (Programming Language) Machine Learning Performance Tuning
+33 more
Regression Testing Inference Optimization Prometheus Software Engineering Systems Integration AI Infrastructure Datadog Data Logging Graphics Processing Unit (GPU) Pytorch Retrieval-Augmented Generation Large Language Models Grafana Model Validation Caching Generative AI Discretization Kubernetes Infrastructure Automation Frameworks Low Latency HuggingFace SGLang Triton Inference Server Machine Learning Operations TensorRT Hardware Infrastructure Restful APIs VLLM Model Inference Terraform Splunk Grpc Docker

Job description

We are looking for an experienced Software Engineer with strong expertise in Machine Learning, Large Language Models (LLMs), and AI infrastructure. The candidate will be responsible for designing, developing, deploying, and optimizing production-grade LLM inference services that power Generative AI applications., * Design, develop, deploy, and maintain scalable LLM inference services.

  • Optimize model serving performance, latency, throughput, and infrastructure costs.
  • Work on inference optimization techniques such as Quantization (INT8/INT4, FP8, AWQ, GPTQ), KV-cache management, Paged Attention, and Prefix Caching.
  • Implement and optimize model serving using TensorRT-LLM, vLLM, SGLang, or Triton Inference Server.
  • Work with PyTorch and the Hugging Face ecosystem.
  • Deploy and manage AI workloads using Kubernetes, Docker, and GPU scheduling.
  • Build integrations with external LLM APIs and internal orchestration frameworks.
  • Implement monitoring, logging, tracing, and observability using Prometheus, Grafana, Splunk, Datadog, or OpenTelemetry.
  • Develop model evaluation and regression testing pipelines.
  • Work with RAG pipelines and vector databases.
  • Perform GPU workload cost optimization and capacity planning.
  • Maintain CI/CD pipelines and Infrastructure as Code.
  • Prepare technical documentation, design documents, and benchmark reports.

Requirements

The ideal candidate should have hands-on experience in model serving, inference optimization, GPU computing, and scalable Kubernetes-based infrastructure., * 5+ years of overall Software Engineering experience.

  • Minimum 2+ years of hands-on experience working with ML/LLM systems in production.
  • Strong programming skills in Python.
  • Working knowledge of Go, C++, or Rust.
  • Experience with TensorRT-LLM, vLLM, SGLang, or Triton Inference Server.
  • Strong understanding of LLM inference optimization and GPU performance tuning.
  • Experience with PyTorch and Hugging Face.
  • Hands-on experience with Kubernetes, Docker, and NVIDIA GPU infrastructure.
  • Knowledge of REST APIs, gRPC, and distributed systems.
  • Experience with model evaluation, performance profiling, and benchmarking.
  • Understanding of CI/CD and Infrastructure as Code tools such as Terraform and Helm. Equal Opportunity Employer: We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…