> Markdown version of [/jobs/ext/2062120-ai-inference-engineer-qvac-100-remote-worldwide](https://www.wearedevelopers.com/jobs/ext/2062120-ai-inference-engineer-qvac-100-remote-worldwide). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Inference Engineer QVAC (100% remote Worldwide) - **Company:** Tether Operations Limited - **Location:** AMSTERDAM, Netherlands (Remote available) - **Contract:** Permanent contract - **Skills:** JavaScript (Programming Language), Artificial Intelligence, C++ (Programming Language), Cloud Computing, Nvidia CUDA, Computer Programming, Distributed Systems, High-Level Architecture, Machine Learning, OpenCL, Peer-To-Peer (P2P), Tethering, Large Language Models, Deep Learning, Information Technology - **Published:** August 15, 2026 - **Apply:** https://www.adzuna.nl/details/5839623542 ## About the Role If you have excellent English communication skills and are ready to contribute to the most innovative platform on the planet, Tether is the place for you. Are you ready to be part of the future?, * Strong programming skills in C++ * Strong experience with Llama.cpp and ggml inference engines, which facilitates the deployment of models to specific GPU architectures * Experience with any GPU framework between Cuda, Vulkan, Metal, OpenCL * Good understanding of deep learning concepts and model architectures * Experience with transformers, LLMs, Diffusion models * Demonstrated ability to rapidly assimilate new technologies and techniques * A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D Bonus points if: * You know how to train/fine-tune a LLM * You have productionized models * You have research experience in new model architectures * You have experience with distributed systems * Javascript experience ## Description You will own the inference backbone behind QVAC's local AI stack: the C++ systems layer that makes models run fast, reliably, and predictably on real user hardware. The role is centered on engineering quality at runtime level, including startup behavior, memory pressure, throughput/latency balance, and long-session stability. You will define and evolve the core abstractions that inference features depend on, so new capabilities can be added without sacrificing performance or maintainability. This is a role for someone who enjoys low-level problem solving, clear technical ownership, and building infrastructure that other teams trust in production. Your work directly enables private, on-device AI experiences and helps set the technical foundation for QVAC's next generation of peer-to-peer AI products. About the job You'll work on the C++ layer that powers local AI, porting and enhancing inference engines like llama.cpp or similar, to run efficiently on edge devices. Your focus is on the runtime: making models load faster, run leaner, and perform well across different hardware. You'll ensure that the inference layer is stable, optimized, and ready for integration with the rest of the stack. This role is for engineers who want to work close to the metal, enabling private and fast on-device AI without relying on cloud infrastructure. Responsibilities * Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml * Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments * Integrate AI features into existing products, enriching them with the latest advancements in machine learning, Recruitment scams have become increasingly common. To protect yourself, please keep the following in mind when applying for roles: * Apply only through our official channels. We do not use third-party platforms or agencies for recruitment unless clearly stated. All open roles are listed on our official careers page: https://tether.recruitee.com/ * Verify the recruiter s identity. All our recruiters have verified LinkedIn profiles. If you re unsure, you can confirm their identity by checking their profile or contacting us through our website. * Be cautious of unusual communication methods. We do not conduct interviews over WhatsApp, Telegram, or SMS. All communication is done through official company emails and platforms. * Double-check email addresses. All communication from us will come from emails ending in @tether.to or @tether.io * We will never request payment or financial details. If someone asks for personal financial information or payment at any point during the hiring process, it is a scam. Please report it immediately. ## Related Videos - [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms) - [AI's threat to uniqueness and belonging](https://www.wearedevelopers.com/videos/1924-ai-s-threat-to-uniqueness-and-belonging) - [Coffee with Developers - Stephen Jones - NVIDIA](https://www.wearedevelopers.com/videos/1303-coffee-with-developers-stephen-jones-nvidia) - [Cloud Vendor Lock-In - Is it just a new version of the Database Abstraction Layers?](https://www.wearedevelopers.com/videos/1185-cloud-vendor-lock-in-is-it-just-a-new-version-of-the-database-abstraction-layers) - [The weekly developer show: Boosting Python with CUDA, CSS Updates & Navigating New Tech Stacks](https://www.wearedevelopers.com/videos/1293-the-weekly-developer-show-boosting-python-with-cuda-css-updates-navigating-new-tech-stacks) - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [The Fastest-Growing Tech Sectors to Look Out for in 2025](https://www.wearedevelopers.com/magazine/373-the-fastest-growing-tech-sectors-to-look-out-for-in-2025) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)