> Markdown version of [/jobs/ext/4729416-ml-systems-engineer-model-architectures-mid-senior-principal](https://www.wearedevelopers.com/jobs/ext/4729416-ml-systems-engineer-model-architectures-mid-senior-principal). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # ML Systems Engineer, Model Architectures (Mid/Senior/Principal) - **Company:** Positron Ai, Inc. - **Location:** United States (Remote available) - **Experience:** Experienced - **Salary:** $160,000 - $350,000 - **Contract:** Permanent contract - **Skills:** Reference Implementation, Extract Transform Load (ETL), Software Debugging, High-Level Architecture, Python (Programming Language), Graphics Processing Unit (GPU), Pytorch, Large Language Models, Discretization, Machine Learning Operations, TensorRT - **Published:** November 15, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=bc5a73db01cf23c4 ## About the Role * 4+ years of experience as an ML systems or inference engineer. * A strong understanding of transformer internals at the operator level, including attention variants, mixture-of-experts, embeddings, KV cache, and quantization (INT8 and FP8). * Demonstrated experience implementing or porting model inference by hand in PyTorch, llama.cpp, vLLM, TensorRT-LLM, or a custom runtime. * Hands-on experience debugging numerical mismatches against a reference down to the operator and the bit. * Ability to read a model architecture paper and turn it into a working, verified implementation. * Strong Rust skills, or expert-level C/C++ skills and a willingness to work in Rust day to day, along with strong Python skills for model and reference work. * Excellent communication skills, with the ability to explain what a new architecture needs from the hardware and where the current design falls short. Preferred Qualifications * Experience mapping models onto accelerator hardware or writing kernels for a non-GPU architecture. * Prior experience serving as the technical point of contact for customer model requests. ## Description As a ML Systems Engineer, you will be the engineer who gets new model architectures running on our hardware first, in simulation, before RTL or silicon exists. You will work with chip architects, the compiler and SDK teams, and customers to understand what each new architecture demands of the hardware and to make sure our simulators can execute it bit-exactly. The work is implementation-heavy: new attention variants, mixture-of-experts, embeddings, and quantization formats, implemented in our simulator and verified against reference frameworks. You will set the standard turnaround for bringing up a new model and drive toward making that path fully automated., Simulator Implementation * Implement the operators, numerics, and memory layouts that new model architectures need in our simulator, bit-exact against a reference implementation. * Extend simulator coverage across the full inference path, including prefill and decode, embeddings, attention variants (grouped-query, gated, linear, and sparse), mixture-of-experts routing, and quantized formats. * Maintain reference comparisons and regression coverage so model support stays correct as the simulator and hardware evolve. Architecture Evaluation * Evaluate new architectures before hardware exists, identifying what they require of compute, memory, and data movement and what the chip would need to change. Customer Model Bring-Up and Automation * Bring customer models up in simulation ahead of emulator and hardware runs, and own the turnaround time for doing so. * Partner with the agentic tooling engineer to automate new-model bring-up end to end, from model specification to simulator coverage.