Applications of ML Engineering Manager

We are hiring a Manager in Responsible Development & Safety, to shape policies and model and application evaluation processes, to ensure safe and responsible deployment of Apple Services’ user-facing features. You will build guidelines for internal engineering, human evaluation, and safety research teams, identify risks and contribute to mitigation strategies for new product features and functions., The role involves collaborating with engineering, research, and product teams to assess and measure the impact of ASE features.

Your role involves ensuring safety best practices, reviewing AI model performance, and providing guidance. You’ll use your expertise in technology’s societal implications to improve the safety development ecosystem as a manager of a small team developing and conducting safety evaluations.”,”responsibilities”:”Shape and support implementation of safety policies defined by AI Product teams.

Collaborate with AIML, Product & Design, Privacy, Human-centered AI, policy leads, and business owners to define model and application evaluation requirements, set priorities, and scope and manage execution of AI /ML model and application evaluations.

Work with Senior Managers to set objectives and key results and the long-term strategy for safety evaluation, including benchmarks, automated methods, and ongoing monitoring of safety performance of AI models.

Lead a team of individual contributors.

Develop new programming and generate opportunities for ASE to regularly engage with Policy, Legal, and Privacy teams.

Develop and document standard processes through working with machine learning engineers and experts, and where appropriate, external organizations.

Do you have experience in Policy Development?, A strong understanding of the challenges and issues in the fields of Responsible AI and/or Safety, through AI and society experience (e.g. relevant governance, policy, legal or research).

Experience working directly with LLMs, LMMs, and generative AI and agentic systems, in a development and/or evaluation capacity.

Experience leading new teams working on innovative initiatives within a well-established organization.

5+ years experiences with AI evaluations, managed with a diverse sets of collaborators, such as Product, Engineering, Security, and Legal teams.

Experience navigating and assessing complex societal questions related to technology development, including balancing the benefits and risks of research and applications.

Strong management skills, including the ability to communicate effectively in tight turnaround times.

Excellent experience collaborating with technical stakeholders and highly interdisciplinary teams.

Strong communication skills, both written and verbal.

Technical Skills:

Proficiency in Python for data analysis (pandas, NumPy, Jupyter, etc.).

Experience working with large datasets, annotation tools, or model-evaluation pipelines.

Ability to design taxonomies, categorization schemes, or structured rating frameworks.

Communication: Strong ability to stitch together qualitative and quantitative findings into actionable guidance.

Minimum Qualifications

Ph.D., J.D. or equivalent experience in Computer Science, Machine Learning, and/or Human-Computer Interaction

5+ years proven experience with AI product and/or user policies in multiple regions of the world

4.14.1 out of 5 stars San Francisco, CA $228,100 - $342,800 a year, Pulled from the full job description

• Employee stock purchase plan
• Health insurance
• Retirement plan
• Dental insurance
• RSU, At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $228,100 and $342,800, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple Services Engineering (ASE) powers many AI features across App Store, Music, Video and more. We build deeply personal products with the goal of representing users around the globe authentically. We work continuously to avoid perpetuating systemic biases and maintain safe and trustworthy experiences across our AI tools and models.