Research Engineer, Pre-training Data - MSL FAIR

The Meta Game, Inc.
Menlo Park, CA, United States
19 days ago
Apply on www.techcareers.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$183,997 - $257,000
Working hours
Regular working hours

Tech stack

Training Data Artificial Intelligence Big Data Computer Engineering Data Infrastructure Apache Hive Machine Learning SQL Databases Pytorch Large Language Models Apache Spark Agentic-AI
+2 more
Information Technology Data Generation

Job description

Meta is seeking AI research engineers to help us build the data foundation for Meta’s most advanced Large Language Models. We’re looking for engineers with LLM expertise to join us on working with data at scale and to push beyond the data ceiling.Our team contributes to data curation across all stages of LLM development (pre-training, mid-training, post-training) and all domains/modalities (e.g., web, code, agent, multilingual). We tackle the hardest challenges at trillion-scale, including organic data curation, synthetic data generation, agent and interaction data, and frontier paradigms that redefine what’s possible. Based in Meta Superintelligence Labs (MSL) within the Fundamental AI Research Organization (FAIR), you’ll directly contribute to Meta’s frontier models like Llama, while having the chance to collaborate with researchers and engineers across MSL., 1. Collaborate with cross-functional teams to develop Meta’s next foundational models

  1. Architect efficient and scalable data curation systems and pipelines
  2. Fundamentally improve our data velocity across workflows and projects by contributing to the advancement of data tooling
  3. Execute on high priority projects in pre-training, mid-training, or post-training data curation
  4. Apply specialized expertise in agentic data, synthetic data, reasoning data, web parser, coding data, data scaling laws, or datamix optimization
  5. Lead complex technical projects end-to-end

Requirements

Research Engineer, Pre-training Data - MSL FAIR Responsibilities, 1. Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

  1. 2+ years of industry research experience in LLM/NLP or related AI/ML models
  2. Experience as a formal technical lead, leading major technical initiatives with cross-functional impact, and/or influencing strategy across multiple teams
  3. Practical experience with pre-training or mid-training data curation for large foundational models and experience working with organic, synthetic, agentic, or reasoning data for LLMs
  4. Demonstrated data infrastructure and software background, and experience building data tooling and services
  5. Published research in leading peer-reviewed conferences (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP) and/or demonstrated significant industry influence in the field of AI, 1. Experience working on frontier-quality/state-of-the-art Large Language Models
  6. Masters degree or PhD in Computer Science or a related technical field
  7. Hands-on experience with modeling frameworks like PyTorch
  8. Hands-on experience on SQL and large-scale data handling, with familiarity of frameworks like Spark and Hive

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.techcareers.com
Prepare application

Good distractions

Loading talks and stories from around this role…