> Markdown version of [/jobs/ext/2712440-machine-learning-engineer-speech-llm-training](https://www.wearedevelopers.com/jobs/ext/2712440-machine-learning-engineer-speech-llm-training). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Machine Learning Engineer, Speech LLM Training - **Company:** PLAUD INC. - **Location:** San Francisco, CA, United States - **Salary:** $200,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Computer Clusters, Program Optimization, Codecs, Software Debugging, Performance Tuning, Signal Processing, Reinforcement Learning, Pytorch, Large Language Models, Generative AI, Kubernetes, TensorRT - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/machine-learning-engineer-speech-llm-training-san-francisco-plaud-8103782 ## About the Role * Have a proven track record of building and training large-scale audio or speech models from the ground up, whether that involves unified SpeechLLMs, advanced ASR, expressive TTS, or generative audio architectures. * Love living at the intersection of research and engineering, eager to design novel sequence modeling architectures one day and debug distributed training clusters the next. * Are highly comfortable traversing the entire stack-from fundamental signal processing and raw acoustic representations to massive foundation model training and edge-device optimization. * Possess deep expertise in PyTorch or JAX, with battle scars from optimizing large-scale distributed training runs, managing GPU memory utilization, and resolving complex performance bottlenecks. * Thrive in a fast-paced, high-growth startup environment where you are expected to take extreme ownership of ambiguous problems and drive them directly into production. * Are obsessed with building AI systems that natively understand and generate speech, ultimately creating a hardware-software AI companion that amplifies human productivity. Strong candidates may also have experience with: * Text-based LLMs: Hands-on experience with core text-based Large Language Model pretraining, instruction tuning, or RLHF. * Neural Audio Codecs: Hands-on experience designing and training state-of-the-art neural audio codecs for streamable, high-fidelity audio. * Generative Architectures: Designing and training diffusion models, flow matching, or autoregressive architectures specifically for speech and voice generation. * Alignment & Steerability: Applying Reinforcement Learning (RL) techniques (like RLHF or GRPO) to improve conversational cadence, steerability, and alignment in foundation models. * Deep System Optimization: End-to-end inference and performance optimization, leveraging high-throughput serving frameworks (e.g., vLLM, TensorRT-LLM, SGLang) to minimize latency for real-time cloud streaming. * Large-Scale Infrastructure: Managing massive GPU clusters, utilizing advanced distributed training frameworks (e.g., FSDP, DeepSpeed), and navigating orchestration tools like Kubernetes. ## Related Videos - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) - [Inside the Mind of an LLM](https://www.wearedevelopers.com/videos/1617-inside-the-mind-of-an-llm) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Can You Touch the Internet? A Journey in Remote Touch With Edge Computing and Haptic Coding](https://www.wearedevelopers.com/videos/1463-can-you-touch-the-internet-a-journey-in-remote-touch-with-edge-computing-and-haptic-coding) - [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms) - [Unlocking the Power of AI: Accessible Language Model Tuning for All](https://www.wearedevelopers.com/videos/951-unlocking-the-power-of-ai-accessible-language-model-tuning-for-all) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)