ML Performance Engineer

We are seeking an AI Performance Optimization Engineer to focus on extracting maximum throughput, minimizing latency, and reducing cost across training and inference workloads for large neural network systems. The role spans the full stack from low-level kernel optimization to distributed system tuning, requiring deep understanding of GPU architecture, model parallelism, memory management, and compiler-level optimization. The ideal candidate has demonstrated impact on production AI workloads, with strong instrumentation and measurement discipline that enables rigorous, data-driven optimization decisions. In this role you will work closely with cross-functional partners - product, design, engineering, operations, and business stakeholders - to translate ambiguous requirements into well-engineered solutions, and will be expected to raise the bar through code review, design review, and mentorship of more junior engineers. The successful candidate brings strong engineering, * Profile and optimize end-to-end AI training and inference pipelines for throughput, latency, and cost.

• Identify and eliminate bottlenecks across data loading, model compute, communication, and memory.
• Implement and tune quantization, sparsity, and pruning strategies to reduce model footprint and accelerate inference.
• Optimize distributed training using tensor parallelism, pipeline parallelism, FSDP, and ZeRO-style sharding.
• Tune attention implementations using FlashAttention, paged attention, and related techniques.
• Implement KV cache optimization, continuous batching, and speculative decoding for LLM serving.
• Drive compiler-level optimizations using Triton, XLA, TorchInductor, or TVM, working with the broader ML framework community to land improvements that translate into measurable end-to-end performance gains.
• Optimize data pipelines, sharding strategies, and storage access patterns for high-throughput training.
• Build and maintain rigorous benchmark suites and regression frameworks across workloads.
• Collaborate with ML and platform engineering teams to embed best practices in standard pipelines.
• Drive cost-efficiency improvements through model architecture, hardware selection, and scheduling strategies.
• Evaluate new hardware and software offerings, and advise on adoption.
• Document performance tuning playbooks and share findings broadly across engineering teams.
• Stay current with AI systems research and translate advances into production improvements.

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position., discipline, a clear communication style, and a track record of shipping meaningful work that holds up well in production., * Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.

• Six or more years of experience in performance engineering, ML systems, or HPC.
• Strong proficiency in Python and C++.
• Hands-on experience optimizing deep learning workloads on modern GPUs.
• Deep understanding of distributed training and inference techniques.
• Experience with profiling tools across CPU, GPU, and distributed systems.
• Familiarity with model compression techniques and their accuracy implications.
• Strong grasp of memory hierarchies, communication primitives, and parallelism strategies.
• Excellent measurement, debugging, and analytical reasoning skills.
• Strong communication and collaboration skills.

Preferred Qualifications

• Experience optimizing LLM inference at production scale.
• Contributions to vLLM, TensorRT-LLM, DeepSpeed, or similar projects.
• Familiarity with custom kernel authoring in Triton or CUTLASS.
• Experience with FinOps for AI workloads.
• Publications or talks on AI systems performance.

We offer a wide range of career opportunities across various domains, from engineering and research to marketing and operations. We provide comprehensive benefits, competitive compensation packages, and a supportive work-life balance to ensure your well-being and success.

Explore our current job openings, and discover how you can contribute to our mission of driving innovation and shaping a brighter tomorrow. We are excited to learn about your skills, experiences, and aspirations, and how they align with our company’s vision.

Thank you for considering Bright Vision Technologies as your potential employer. We look forward to welcoming you to our talented team and embarking on an exciting journey together.

At Bright Vision Technologies, we believe that innovation and talent go hand in hand. We are delighted that you are considering a career with us and taking the first step towards joining our dynamic team.

As a leading technology company, we are driven by a shared vision to create a brighter future through groundbreaking solutions. We embrace creativity, collaboration, and a passion for excellence in everything we do.

Our work environment is built on trust, respect, and inclusivity. We value diversity and understand the power of different perspectives coming together to drive innovation. We foster a culture of continuous learning and growth, where you can expand your skills, explore new horizons, and reach your full potential.

Joining Bright Vision Technologies means being part of a team that pushes boundaries and pioneers cutting-edge technologies. We tackle complex challenges and deliver transformative solutions that make a real impact in the world. Your contributions will be valued, and your ideas will shape the future of our company., Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.