Anthropic Fellows Program, AI Safety & Security

Academic Ltd
Epsom, United Kingdom
3 days ago
Apply on www.apply4u.co.uk
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Compensation
£41,280 - £55,380
Working hours
Regular working hours

Tech stack

Computer-Aided Design Artificial Intelligence Python (Programming Language) Language Modeling Open Source Technology Software Safety Large Language Models Information Technology

Job description

Scalable Oversight: Developing techniques to keep highly capable models helpful and honest, even as they surpass human-level intelligence in various domains.

Adversarial Robustness and AI Control: Creating methods to ensure advanced AI systems remain safe and harmless in unfamiliar or adversarial scenarios.

Model Organisms: Creating model organisms of misalignment to improve our empirical understanding of how alignment failures might arise.

Model Internals / Mechanistic Interpretability: Advancing our understanding of the internal workings of large language models to enable more targeted interventions and safety measures.

AI Welfare: Improving our understanding of potential AI welfare and developing related evaluations and mitigations.

Past projects

Subliminal Learning: Language Models Transmit Behavioral Traits via Hidden Signals in Data: Alex Cloud and Minh Le, et al., mentors including Samuel Marks and Owain Evans

Open-source circuits: Michael Hanna and Mateusz Piotrowski with mentorship from Emmanuel Ameisen and Jack Lindsey

Requirements

The expected base stipend for this role is 4,615 USD / 3,440 GBP / 6,470 CAD / 4,110 EUR per week, with an expectation of 40 hours per week for 4 months (with possible extension). Across the workstreams, you may be a good fit if you: Are motivated by making sure AI is safe and beneficial for society as a whole Are excited to transition into empirical AI research and would be interested in a full-time role at Anthropic Have a strong technical background in computer science, mathematics, or physics Thrive in fast-paced, collaborative environments Can implement ideas quickly and communicate clearly Strong candidates may also have: Strong background in a discipline relevant to a specific Fellows workstream (e.g. economics, social sciences, or cybersecurity) Experience in areas of research or engineering related to their workstream

Candidates must be

Fluent in Python programming

Available to work full-time on the Fellows program

Benefits & conditions

Weekly stipend of 4,615 USD / 3,440 GBP / 6,470 CAD / 4,110 EUR + benefits (these vary by country)

About the company

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.apply4u.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…