> Markdown version of [/jobs/ext/2845339-ai-engineer](https://www.wearedevelopers.com/jobs/ext/2845339-ai-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Engineer - **Company:** Opsward AI LLC - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** A/B Testing, Agile Methodology, Artificial Intelligence, Amazon Web Services, Microsoft Azure, C++ (Programming Language), Program Optimization, Complex Networks, Nvidia CUDA, System Configuration, Continuous Integration, Python (Programming Language), Scrum Methodology, Software Deployment, Software Engineering, Graphics Processing Unit (GPU), Load Balancing, Autoscaling, Large Language Models, Build Management, Information Technology, Machine Learning Operations, TensorRT, Decoding - **Published:** September 11, 2026 - **Apply:** https://www.thejobnetwork.com/job/c1622deb-7b6f-4a54-89d1-ae89567f9322/senior-ai-engineer ## About the Role - Bachelor's degree in Computer Science, Software Engineering, or a related field. - 5+ years of experience in software engineering, with a focus on ML infrastructure, LLM inference, or model optimization. - Hands on experience deploying and serving LLMs on GPU hardware in production. - Strong understanding of quantization and model compression (FP8/FP4/INT8/INT4, GPTQ, AWQ, SmoothQuant, QAT). - Experience with high throughput inference engines (vLLM, TensorRT-LLM, TGI, llama.cpp). - Solid understanding of GPU architecture, CUDA, and the memory bandwidth bound nature of LLM inference. - Familiarity with KV cache, continuous batching, PagedAttention, and speculative decoding. - Solid understanding of software development methodologies (Agile, Scrum, etc.). - Good communication, collaboration, and problem solving skills. - Ability to work independently and as part of a team in a fast paced environment. - Proficiency in Python; familiarity with C++/CUDA is a strong plus. **It Would Be Nice if You Have** - Experience writing or tuning custom CUDA / Triton kernels. - Experience with multi GPU and distributed inference. - Certifications in AWS or Azure architecture. - Experience with CI/CD and cloud production deployment (Azure, AWS, or GCP), including GPU backed instances. ## Description OPSWAT, a global leader in IT, OT, and ICS critical infrastructure cybersecurity, delivers an end-to-end platform that gives public and private sector organizations and enterprises the critical advantage needed to protect their complex networks, secure their devices, and ensure compliance. Over the last 20 years our commitment to innovative technology has earned the trust of more than 1,700 organizations, governments, and institutions globally, solidifying our role in protecting the world's critical infrastructure and securing our way of life. , OPSWAT is committed to harnessing the power of AI to drive meaningful advancements across all areas of our business. We are currently seeking a highly skilled Senior AI Engineer to lead the deployment and optimization of Large Language Models for efficient, high performance inference on GPU hardware. In this role, you will own the infrastructure layer that turns our AI models into fast, cost effective, production grade services. You will work closely with the AI/ML Team, the Enterprise & Data Team, and Infrastructure to design local LLM serving environments, maximize GPU utilization, and apply model compression techniques such as quantization from FP32 down to FP8/FP4. This is a chance to work at the deep intersection of models, serving software, and hardware within a global cybersecurity company, delivering the performance that powers OPSWAT's AI products at scale. **What You Will Do** - **Local LLM Deployment & Hardware Setup:** Design and build local LLM serving environments on GPU hardware, selecting GPU configurations based on VRAM, memory bandwidth, and workload. Install and maintain the full inference stack (NVIDIA drivers, CUDA, cuDNN, inference engines) across single and multi GPU deployments, including tensor and pipeline parallelism. - **Inference Optimization & Model Compression:** Optimize LLM models for efficient GPU serving, balancing latency, throughput, memory, and cost. Apply quantization from FP32 to FP16/BF16, FP8, and FP4 using PTQ methods (GPTQ, AWQ, SmoothQuant) and QAT. Design mixed precision strategies and run calibration to minimize quality loss. Apply complementary techniques including pruning, distillation, and sparsity. - **Serving Engine & Performance Engineering:** Deploy and tune high throughput serving engines (vLLM, TensorRT-LLM, TGI), optimizing KV cache (PagedAttention), continuous batching, and speculative decoding. Leverage optimized kernels (FlashAttention) and FP8 tensor cores. Build benchmarking for TTFT, inter token latency, throughput, GPU utilization, and cost per million tokens. - **Production Serving Infrastructure:** Deploy quantized models with autoscaling, load balancing, and observability. Establish quality regression gates and run A/B tests of quantized vs full precision models on real traffic. - **Research & Propose Innovative Solutions:** exploring and implementing novel inference optimization and model compression techniques. **What We Need From You** ## Related Videos - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) - [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms) - [Fifty Shades of Kubernetes Autoscaling](https://www.wearedevelopers.com/videos/813-fifty-shades-of-kubernetes-autoscaling) - [Trends, Challenges and Best Practices for AI at the Edge](https://www.wearedevelopers.com/videos/630-trends-challenges-and-best-practices-for-ai-at-the-edge) - [Challenges and Solutions for Efficient, Large-Scale Video Analysis](https://www.wearedevelopers.com/videos/2022-challenges-and-solutions-for-efficient-large-scale-video-analysis) - [Serverless-Native Java with Quarkus](https://www.wearedevelopers.com/videos/243-serverless-native-java-with-quarkus) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)