Machine Learning Engineer - Training Optimization

Jobgether
Huelva, Spain
7 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Artificial Intelligence Systems Engineering Artificial Neural Networks Profiling Computer Programming Distributed Systems Fault Tolerance Systems Analysis Machine Learning Open Source Technology Pytorch Large Language Models
+2 more
Optimization Algorithms Production Code

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Machine Learning Engineer - Training Optimization based in Spain.This role offers the opportunity to improve the foundations behind large-scale AI model development and deployment.You will work at the intersection of machine learning research, systems engineering, and production optimization.The position focuses on making model training faster, more stable, and more cost-efficient through advanced engineering techniques.You will optimize training pipelines, improve distributed systems, and collaborate with researchers to push model capabilities forward.This is a high-impact opportunity for an engineer who enjoys solving complex performance challenges at scale.You will have significant ownership in shaping training infrastructure, experimentation workflows, and the future of AI systems.AccountabilitiesAs a Machine Learning Engineer focused on Training Optimization, you will improve the efficiency, scalability, and reliability of large-scale model training systems. You will combine deep technical expertise with practical engineering execution to optimize how advanced AI models are developed.Optimize large-scale model training pipelines to improve throughput, convergence, stability, and overall computational efficiency.Improve distributed training approaches, including data parallelism, model parallelism, and pipeline parallelism strategies.Tune key training components such as optimizers, learning rate schedulers, batch sizes, and numerical precision methods including bf16, fp16, and fp8.Identify and resolve performance bottlenecks through profiling, system analysis, and infrastructure-level improvements.Collaborate closely with research teams to develop architecture-aware training strategies and improve model performance.Build and maintain reliable training infrastructure, including checkpointing systems, fault tolerance mechanisms, and reproducible workflows.Evaluate and integrate advanced training techniques such as gradient checkpointing, ZeRO, FSDP, and custom optimization solutions.Define, monitor, and improve training performance metrics to continuously enhance efficiency.Translate research concepts into production-ready systems and scalable engineering solutions.RequirementsThe ideal candidate is a machine learning engineer with strong experience in training large neural networks and optimizing complex AI systems. You should be comfortable working across research and engineering environments while solving challenging scalability and performance problems.Strong experience training large-scale neural networks, including large language models or similarly complex architectures.Hands-on experience with machine learning training optimization, beyond simply using existing models.Strong understanding of backpropagation, optimization algorithms, training dynamics, and model convergence behavior.Experience with distributed machine learning training systems and large-scale computing environments.Proficiency with PyTorch and modern machine learning development workflows.Ability to work close to hardware constraints, including GPU performance, memory limitations, and networking considerations.Strong programming skills with the ability to transform research ideas into reliable production code.Experience with multi-node and multi-GPU training environments is highly preferred.Familiarity with frameworks and technologies such as DeepSpeed, FSDP, Megatron, or custom training stacks is a plus.Experience optimizing workloads on NVIDIA or AMD GPU platforms is beneficial.Contributions to open-source machine learning infrastructure or research projects are valued.Exposure to alternative neural network architectures beyond Transformers is a plus.BenefitsCompetitive compensation package with meaningful equity opportunities.Opportunity to work on cutting-edge AI models and large-scale training systems.High ownership role where your contributions directly influence technical direction and company growth.Collaboration with a small, highly technical team focused on engineering excellence and research innovation.Fast feedback loops and an environment that encourages experimentation and impact.Opportunity to solve complex machine learning infrastructure challenges at significant scale.Strong emphasis on technical quality, continuous learning, and advanced AI development.Ability to contribute to foundational systems shaping future AI capabilities.#J-*****-Ljbffr

Requirements

The ideal candidate is a machine learning engineer with strong experience in training large neural networks and optimizing complex AI systems. You should be comfortable working across research and engineering environments while solving challenging scalability and performance problems. Strong experience training large-scale neural networks, including large language models or similarly complex architectures. Hands-on experience with machine learning training optimization, beyond simply using existing models. Strong understanding of backpropagation, optimization algorithms, training dynamics, and model convergence behavior. Experience with distributed machine learning training systems and large-scale computing environments. Proficiency with PyTorch and modern machine learning development workflows. Ability to work close to hardware constraints, including GPU performance, memory limitations, and networking considerations. Strong programming skills with the ability to transform research ideas into reliable production code. Experience with multi-node and multi-GPU training environments is highly preferred. Familiarity with frameworks and technologies such as DeepSpeed, FSDP, Megatron, or custom training stacks is a plus. Experience optimizing workloads on NVIDIA or AMD GPU platforms is beneficial. Contributions to open-source machine learning infrastructure or research projects are valued. Exposure to alternative neural network architectures beyond Transformers is a plus., Opportunity to solve complex machine learning infrastructure challenges at significant scale. Strong emphasis on technical quality, continuous learning, and advanced AI development. Ability to contribute to foundational systems shaping future AI capabilities. #J-*****-Ljbffr

Benefits & conditions

Competitive compensation package with meaningful equity opportunities. Opportunity to work on cutting-edge AI models and large-scale training systems. High ownership role where your contributions directly influence technical direction and company growth. Collaboration with a small, highly technical team focused on engineering excellence and research innovation. Fast feedback loops and an environment that encourages experimentation and impact.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

47 sec

Profiling native execution calls with async-profiler

Gonzalo Ortiz Jaureguizar Gonzalo Ortiz Jaureguizar · World Congress 2026 Europe

1:05 min

Practical Byzantine Fault Tolerance in distributed computing systems

Jonan Scheffler · World Congress 2022

5:01 min

Leveraging large language models for code optimization and development

Stephan Gillich Stephan Gillich +3 · World Congress 2024

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · World Congress 2026 Europe

1:06 min

Compiling PyTorch environments for advanced time forecasting

Christoph Lohrmann Christoph Lohrmann +1 · World Congress 2026 Europe

Videos

See all

Related articles

See all