Senior Software Engineer (AI Systems Performance) | Remote (Brazil)

Luxoft Usa, Inc.
United States
15 days ago
Apply on arc.dev
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence C++ (Programming Language) Computer Programming Software Debugging Programming Tools Distributed Systems Github Python (Programming Language) Machine Learning Node.Js Software Engineering Graphics Processing Unit (GPU)
+11 more
Parallel Computation Kubernetes Low Latency Performance Monitor SGLang Hardware Acceleration Slurm VLLM Model Inference llama.cpp Jenkins

Job description

Are you passionate about high-performance computing, distributed inferencing on GPUs, and pushing the boundaries of AI hardware and software?, * Distributed AI Enablement & Benchmarking: Enable and benchmark AI models on large-scale distributed systems to evaluate performance, accuracy, and scalability.

  • Scalable Systems Optimization: Optimize AI workloads across scale-up (multi-GPU), scale-out (multi-node), and scale-across distributed system configurations.
  • Cross-Team Collaboration: Partner closely with internal GPU library teams to analyze and optimize distributed workloads for high throughput and ultra-low latency.
  • Parallelization Strategies: Develop and apply optimal parallelization strategies for AI workloads to achieve best-in-class performance across diverse hardware topologies.
  • Model Infrastructure & Management: Contribute to distributed model management systems, model zoos, monitoring frameworks, benchmarking pipelines, and technical documentation.
  • Performance Monitoring & Visualization: Build and maintain real-time dashboards reporting performance, accuracy, and reliability metrics for internal stakeholders and external users.

Requirements

  • AI Framework Engineering: Hands-on experience with AI inference or serving frameworks such as vLLM, SGLang, and Llama.cpp.
  • KV Cache and Expert Parallelization: Understanding KV cache transfer mechanisms and technologies (e.g., Mooncake, NIXL/RIXL) and expert parallelization approaches (e.g., DeepEP, MORI, PPLX-Garden).
  • Programming and Software Design: Strong C/C++ and Python skills, with experience in software design, debugging, performance analysis, and test development.
  • Large-Scale Distributed Systems: Experience running AI workloads on large-scale, heterogeneous compute clusters.
  • Cluster and Orchestration Systems: Familiarity with cluster management and orchestration platforms such as SLURM and Kubernetes (K8s).
  • Development Tools and Workflows: Experience with GitHub, Jenkins, or similar CI/CD tools and modern development workflows.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on arc.dev
Prepare application

Good distractions

Loading talks and stories from around this role…