Machine Learning Research Scientist (Remote | $140-$150/hr) in San Francisco

AfterQuery partners with leading AI research organizations to evaluate and improve frontier AI systems. We are seeking experienced Machine Learning Research Experts with a proven research track record to design benchmark tasks, evaluate model capabilities, and contribute expert-level ML reasoning to next- AI systems., * At least one first-author research publication in Machine Learning, Artificial Intelligence, or a closely related field. \n

• Master’s or PhD in Machine Learning, Computer Science, Statistics, Mathematics, or a related quantitative discipline (completed or currently in progress). \n

• Minimum 1 year of hands-on machine learning research experience. \n

• Strong experience developing, training, evaluating, or deploying machine learning models. \n

• Demonstrated proficiency in machine learning programming and experimentation. \n

• Ability to design technically rigorous research problems and evaluation frameworks. \n

• Excellent written communication and technical documentation skills. \n

n \n

• Design realistic machine learning research tasks and benchmark problems. \n

• Develop expert-level reference solutions and evaluation methodologies. \n

• Create grading rubrics that assess model reasoning, implementation quality, and scientific correctness. \n

• Evaluate AI-generated solutions for technical accuracy, research validity, and methodological rigor. \n

• Author problem sets covering advanced machine learning concepts and research workflows. \n

• Review model outputs and identify weaknesses in reasoning, implementation, experimentation, and interpretation. \n

• Document expected solutions, evaluation criteria, and benchmark standards. \n

• Contribute domain expertise to improve the quality of frontier AI evaluation systems. \n

\n