Machine Learning Researcher / Engineer (Foundational Models)
Role details
Job location
Tech stack
Job description
We are currently searching for 1 or 2 R&D Engineers with a strong track record in machine learning models research.
This is an extremely ambitious foundational project. There is a flexible GPU budget associated with this specific project, guaranteed to be in the 7-digit range minimum.
You Will
- perform (distributed) model training.
- help improve/adapt model architectures based on experiment results.
- design new tasks and experiments. optionally: oversee activities of team members involved in data preparation.
The results of your work will play a crucial role in the success of the project.
Requirements
Do you have a Doctoral degree?, * You have published at least one paper at NeurIPS, ICLR, or ICML - where you were the lead author or made significant conceptual & code contributions.
- You have significantly contributed to an LLM training effort which became newsworthy (topped a Huggingface benchmark, best in class model, etc.), preferably using multiple GPU's.
- You have spent at least 6 months working in a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA).
- You were an ICPC World Finalist, or an IOI, IMO, or IPhO medalist in High School., * A deep learning researcher, with a track record in Language Models and/or RL (candidates with a Vision or Robotics ML background are also welcome to apply).
- Interested in improving foundational architectures and creating new benchmarks.
- Experienced at hands-on experiments and model training (PyTorch, Jax, or Tensorflow).
- Have a good understanding of GPU architecture, memory design, and communication.
- Have a good understanding of graph algorithms.
- Have some familiarity with model monitoring, git, build systems, and CI/CD.
- Respectful of others
- Fluent in English, * Knowledge of approaches used in distributed training.
- Familiarity with Triton
- Successful track-record in algorithms & data science contests.
- Showing a code portfolio.
Benefits & conditions
- Type of contract: Full-time, permanent
- Preferable joining date: Immediate. The positions are open until filled - please apply immediately.
- Compensation: six-digit annual salary based on profile and location + Employee Stock Option Plan.
- Location: Remote work. Possibility to work or meet with other team members in one of our offices: Palo Alto, CA; Paris, France or Wroclaw, Poland. Candidates based anywhere in the EU, UK, United States, and Canada will be considered.
If you meet our broad requirements but are missing some experience, don't hesitate to reach out to us. If you require alternative methods of application or screening, you must approach the employer directly to request this as Indeed is not responsible for the employer's application process.