Machine Learning Engineer - Video Generation Models

Apple Inc.
Ramona, CA, United States
7 days ago
Apply on www.themuse.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$142,300.0
Working hours
Regular working hours

Tech stack

Computer Clusters Computer Engineering Software Debugging Distributed Computing Environment Python (Programming Language) Machine Learning Node.Js Software Engineering Pytorch Deep Learning Information Technology

Job description

We are hiring a machine learning engineer with deep, hands-on experience training large generative models to help build our video generation models. You will work across pre-training, fine-tuning, and inference optimization, from designing the training recipe and running large distributed training jobs through making the resulting models efficient to run. As a member of the team, you will develop fundamental model capabilities and collaborate with engineers and researchers across Apple to advance our products., As a member of our fast-paced group, you’ll have the unique and rewarding opportunity to shape upcoming products from Apple. We are looking for someone who has taken large generative models through the full lifecycle, from pre-training through fine-tuning and efficient inference, and can bring that depth to video, with the engineering skills to make that work reproducible and production-ready., Pre-training video generation models, including architecture selection, training recipe design, hyperparameter and scaling decisions, and evaluation of model quality

Running, monitoring, and debugging large-scale distributed training jobs, and diagnosing loss instabilities, divergence, and throughput regressions

Improving training efficiency and cost, including parallelism strategy, mixed-precision training, checkpointing, and hardware utilization

Improving inference efficiency through step distillation, few-step sampling, and quantization, and characterizing the resulting quality and latency trade-offs

Adapting pre-trained models through fine-tuning, preference optimization, and knowledge distillation

Building and maintaining the training and evaluation code the team depends on, with an emphasis on reproducibility and reliability

Partnering with product and research stakeholders to translate requirements into modeling and engineering tasks

Requirements

MS or PhD in Electrical Engineering, Computer Science, or Computer Engineering

Experience with video generation architectures, including diffusion or autoregressive models, temporal consistency, and long-horizon generation

Experience contributing to major foundation or base model pre-training efforts, including scaling laws and transferring training recipes across model and training scales

Experience with large-scale training operations, including parallelism strategies and diagnosing loss instability, divergence, or throughput regressions

Experience improving and adapting trained models, such as step distillation, few-step sampling, or quantization for inference efficiency, and supervised fine-tuning, preference optimization, or knowledge distillation for quality

Ability to work through ambiguity, collaborate across teams and disciplines, and communicate complex technical results clearly, Bachelor’s degree in Electrical Engineering, Computer Science, Computer Engineering, or relevant degree, and a minimum of 3 years relevant industry experience

Experience with large-scale generative model training for video generation

Experience running distributed training across multi-node GPU clusters

Strong software engineering skills in Python, with proficiency in a modern deep learning framework such as PyTorch or JAX

Benefits & conditions

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $142,300 and $263,300, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

About the company

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.themuse.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

45 sec

Working securely with Node.js path application programming interfaces

Sonya Moisset · World Congress 2023

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

1:25 min

Distinguishing artificial intelligence from deep learning

Sam Witteveen · Coffee With Developers

3:09 min

Evolution of machine learning and generative AI

Aarno Aukia · LIVE

3:55 min

Identifying underlying Node.js runtime vulnerabilities using fuzzing tools

Sonya Moisset · World Congress 2023

8:37 min

AI video generation tools and content creation challenges

Chris Heilmann +2 · LIVE

Videos

See all

Related articles

See all