Senior Software Engineer (AI Systems Performance) | Remote (Brazil)
Luxoft Usa, Inc.
United States
15 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on arc.dev
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
C++ (Programming Language)
Computer Programming
Software Debugging
Programming Tools
Distributed Systems
Github
Python (Programming Language)
Machine Learning
Node.Js
Software Engineering
Graphics Processing Unit (GPU)
+11 more
Parallel Computation
Kubernetes
Low Latency
Performance Monitor
SGLang
Hardware Acceleration
Slurm
VLLM
Model Inference
llama.cpp
Jenkins
Job description
Are you passionate about high-performance computing, distributed inferencing on GPUs, and pushing the boundaries of AI hardware and software?, * Distributed AI Enablement & Benchmarking: Enable and benchmark AI models on large-scale distributed systems to evaluate performance, accuracy, and scalability.
- Scalable Systems Optimization: Optimize AI workloads across scale-up (multi-GPU), scale-out (multi-node), and scale-across distributed system configurations.
- Cross-Team Collaboration: Partner closely with internal GPU library teams to analyze and optimize distributed workloads for high throughput and ultra-low latency.
- Parallelization Strategies: Develop and apply optimal parallelization strategies for AI workloads to achieve best-in-class performance across diverse hardware topologies.
- Model Infrastructure & Management: Contribute to distributed model management systems, model zoos, monitoring frameworks, benchmarking pipelines, and technical documentation.
- Performance Monitoring & Visualization: Build and maintain real-time dashboards reporting performance, accuracy, and reliability metrics for internal stakeholders and external users.
Requirements
- AI Framework Engineering: Hands-on experience with AI inference or serving frameworks such as vLLM, SGLang, and Llama.cpp.
- KV Cache and Expert Parallelization: Understanding KV cache transfer mechanisms and technologies (e.g., Mooncake, NIXL/RIXL) and expert parallelization approaches (e.g., DeepEP, MORI, PPLX-Garden).
- Programming and Software Design: Strong C/C++ and Python skills, with experience in software design, debugging, performance analysis, and test development.
- Large-Scale Distributed Systems: Experience running AI workloads on large-scale, heterogeneous compute clusters.
- Cluster and Orchestration Systems: Familiarity with cluster management and orchestration platforms such as SLURM and Kubernetes (K8s).
- Development Tools and Workflows: Experience with GitHub, Jenkins, or similar CI/CD tools and modern development workflows.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on arc.dev
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…