Senior Machine Learning Engineer, Ads Experimentation & Measurements

Unity Technologies
Mountain View, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 259K

Job location

Mountain View, United States of America

Tech stack

A/B testing
Artificial Intelligence
Big Data
Google BigQuery
Software Quality
Computer Programming
Python
Machine Learning
Usage Analysis
Snowflake
Spark
Information Technology
Real Time Data

Job description

Unity's Ads Experimentation Platform team is looking for a senior machine learning engineer to lead the evolution of how we validate and optimize our global advertising ecosystem. At Unity, our ads reach billions of devices, and the ability to rapidly iterate on machine learning models or ads delivery pipelines is critical to our growth.

In this role, you will be the technical authority for our experimentation and evaluation roadmap. You will bridge the gap between advanced statistical methodology and large-scale engineering, building the tools that allow ML teams to iterate faster and with higher confidence. You will join a team focused on high-velocity innovation, moving beyond standard A/B testing into the next generation of causal inference and high-sensitivity evaluation methodologies.

What you'll be doing

  • Ad Delivery Expertise: Hands-on experience evaluating pacing and ad selection systems, with strong domain knowledge of the ads ecosystem (advertiser objectives, bidding/pricing dynamics, attribution, and marketplace mechanics) and practical familiarity with simulation-based measurement to pre-validate model and policy changes before live deployment.
  • Product Analytics & Insights: Demonstrated ability to drive product decisions through analytics - defining metrics, building measurement frameworks, analyzing A/B test results, and translating experiment outcomes into clear, actionable insights for ML, Product, and Business partners
  • Advance Experimentation Platform: design the statistical methodologies of our experimentation platform in a complex, budget-constrained environment. You will lead the implementation of variance reduction (CUPED), sequential testing, and interleaving frameworks to maximize sensitivity and accelerate evaluation cycles. You will also build the statistical foundations for automated pipelines that autonomously test and select optimal features and hyperparameters at scale.
  • Define Long-Term Value (LTV) Proxy Metrics: Research and validate surrogate metrics that correlate highly with long-term user retention, churn, and value. You will provide ML teams with short-term signals that accurately predict long-term impact, enabling faster optimization for long-term growth.
  • Drive Automated ML Experimentation: Build the statistical foundations for automated pipelines that autonomously test and select optimal features and hyperparameters. This reduces manual engineering overhead and accelerates the deployment of high-performing models at scale.
  • Cross-Functional Technical Leadership: Serve as the lead subject matter expert on experimentation for ML, Product, and Engineering teams. You will ensure statistical rigor is integrated throughout the product lifecycle, from initial model training to live production auctions.

Requirements

  • 5+ years of experience in Data Science or Applied Research, specifically within Ad Tech, Marketplaces, or high-scale experimentation platforms.
  • Advanced Education: An MS or PhD in a quantitative field (Statistics, Economics, Computer Science, Operations Research, or equivalent).
  • Deep expertise in causal inference, experimental design, and frequentist/Bayesian statistics, with a proven track record of applying these to high-volume, real-time data.
  • Strong programming skills in Python or Scala, and experience with large-scale data processing frameworks like Spark, Snowflake, or BigQuery.
  • Practical experience implementing advanced testing methodologies like CUPED, interleaving, or switchback testing in production environments.
  • Ability to translate complex statistical concepts into clear product roadmaps and mentor engineering teams on experimental rigor., * Experience building or maintaining internal experimentation platforms at a major tech company.
  • Familiarity with the unique challenges of long-term value (LTV) prediction and surrogate metric design in mobile gaming or digital advertising.
  • Experience embracing AI as a strategic advantage in engineering, following established best practices for code quality and security, This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English.

Benefits & conditions

At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance.

Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.

While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally: Comprehensive health, life, and disability insurance | Commute subsidy | Employee stock ownership | Competitive retirement/pension plans | Generous vacation and personal days | Support for new parents through leave and family-care programs | Office food snacks | Mental Health and Wellbeing programs and support | Employee Resource Groups | Global Employee Assistance Program | Training and development programs | Volunteering and donation matching program

About the company

Unity [NYSE: U] is the world's leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D - closing the gap between ideas and reality. For more information, please visit www.unity.com. Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form (https://docs.google.com/forms/d/e/1FAIpQLSdrbRLG1N-apH1eahQ622Gypo-rmiAB6LLTP1UsSWQNu7omxQ/viewform) to let us know.

Apply for this position