> Markdown version of [/jobs/ext/4711786-ml-infrastructure-and-performance-engineer-ai-expert-remote](https://www.wearedevelopers.com/jobs/ext/4711786-ml-infrastructure-and-performance-engineer-ai-expert-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # ML Infrastructure and Performance Engineer, AI Expert (Remote) - **Company:** WEEKDAYS LLC - **Location:** United States (Remote available) - **Experience:** Experienced - **Salary:** $187,200 - $249,600 - **Contract:** Permanent contract - **Skills:** Training Data, Artificial Intelligence, Systems Engineering, Profiling, Nvidia CUDA, Computer Programming, Shard (Database Architecture), Software Debugging, Distributed Computing Environment, Distributed Systems, Linux Kernel, Language Modeling, Performance Tuning, Windows Software Trace Preprocessor, Pytorch, Large Language Models, AWS Trainium, SGLang, Machine Learning Operations, TensorRT, VLLM, Model Inference, CUTLASS, Megatron, MLIR (Multi-Level Intermediate Representation) - **Published:** November 14, 2026 - **Apply:** https://www.careerbuilder.com/job-details/ml-infrastructure-and-performance-engineer-ai-expert-remote--8c7eb7c5-16db-485f-b1ab-da5b92c18f67 ## About the Role Performance Engineering, Artificial Intelligence (AI), Performance Engineering, Debugging Skills, Artificial Intelligence (AI), Modeling Languages, Analysis Skills, Systems Engineering, High Throughput, Performance Tuning/Optimization, The ideal candidate will have hands-on experience in ML systems engineering, accelerator performance optimization, distributed workloads, or large-scale model serving. Expertise in areas such as custom accelerator kernels, performance profiling, trace analysis, distributed systems debugging, and high-throughput inference is particularly valuable. Experience with JAX, XLA, and TPU-based infrastructure will be a strong advantage., * At least 2 years of hands-on professional experience in ML systems, ML infrastructure, model serving, accelerator performance engineering, or a closely related field. * Practical experience in at least one of the following areas: * + Accelerator Kernel Programming: Developing or optimizing custom kernels using Pallas, Triton, CUDA, CUTLASS, or similar technologies. + Performance Profiling: Working with profiling and trace-analysis tools such as JAX/XLA Profiler, Kineto, torch.profiler, or NVIDIA Nsight. + Distributed Workload Debugging: Identifying and resolving performance and execution issues in distributed or accelerator-intensive workloads. + LLM Inference Serving: Experience with vLLM, SGLang, TensorRT-LLM, JetStream, KV cache optimization, paged attention, or continuous batching. * Production-level experience with JAX and/or PyTorch. * Understanding of modern accelerator architectures, including TPUs (v4-v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300. * Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency. * Demonstrable professional growth and career progression in engineering or infrastructure-focused roles. * Availability to commit at least 40 hours per week on weekdays. * Excellent written communication skills, with the ability to explain complex technical concepts and engineering decisions clearly., * Experience with JAX, XLA, and TPU-based development environments. * Knowledge of custom operators, sharding, and distributed training frameworks such as pjit, shard_map, FSDP, Megatron, or MaxText. * Familiarity with compiler and graph-level technologies such as XLA, StableHLO, torch.compile, and MLIR. * Experience developing performance benchmarks, technical evaluation frameworks, or engineering assessment rubrics. * Exposure to AI model evaluation, synthetic training data generation, or working with frontier AI systems. ## Description * Design challenging technical tasks covering accelerator kernel development, performance profiling, distributed workload debugging, and high-throughput inference serving. * Develop complex and adversarial engineering problems that test the capabilities of advanced AI models, including tasks involving accelerator programming and optimization. * Create accurate, technically sound reference solutions that demonstrate best practices in ML systems engineering. * Evaluate AI-generated solutions for correctness, efficiency, scalability, and practical applicability. * Develop detailed technical guidelines and assessment rubrics for kernel optimization, profiler interpretation, distributed systems, and inference performance. * Analyze performance bottlenecks across ML infrastructure, compilers, accelerators, and model-serving systems. * Provide clear, structured technical feedback to help improve AI model capabilities in ML systems and infrastructure engineering. * Collaborate with researchers and fellow subject matter experts to maintain the quality, consistency, and accuracy of AI training and evaluation data.