Experimentation Lead, Sign-Up and Cancellation Optimization
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
Paramount Streaming is investing heavily in personalization, experimentation, and applied AI to shape how millions of viewers begin and continue their journey with Paramount+ and Pluto TV.We are seeking an Experimentation Lead to own and scale experimentation across the sign-up and cancellation flows. This is a highly strategic and execution-oriented role focused on identifying, prioritizing, launching, and scaling experiments that directly impact conversion, retention, and lifetime value.Reporting to the Principal Machine Learning Engineer for Sign-Up Optimization, you will act as the connective tissue between product, ML, engineering, data science, design, and growth ensuring we are running the right experiments, running them well, and learning from them rigorously. This role blends product thinking, scientific rigor, experimentation design, and operational management.
What Youll Do
Experimentation Strategy & Roadmapping
- Define and own the experimentation roadmap across sign-up, onboarding, andcancellation flows for Paramount+ and Pluto TV.
- Identify high-impact test opportunities across UX, messaging, offers,personalization, pricing, bundling, and model-driven experiences.
- Translate business goals (conversion, churn reduction, engagement, LTV) intostructured, testable hypotheses.
- Prioritize experiments using data-driven frameworks balancing impact, risk, andresource constraints.
End-to-End Experiment Ownership
- Drive experiments from ideation design instrumentation launch feedback iteration.
- Partner with ML engineers and applied scientists to test model-driven experiences(ranking, personalization, content ordering, offer targeting).
- Ensure experiment configurations are correctly implemented and debug issues intargeting, logging, or exposure.
- Monitor live experiments for integrity, guardrail breaches, or unintended sideeffects.
- Lead post-test readouts and translate results into clear, actionable next steps.
Scientific Rigor & Measurement
- Design robust A/B, multivariate, and sequential testing frameworks.
- Define primary metrics, guardrails, and success criteria aligned to long-term value,not just short-term conversion.
- Improve offline-to-online validation practices in partnership with ML teams.
- Standardize experimentation best practices across the Applied Intelligence group.
- Champion causal reasoning and statistical discipline in decision-making.
Cross-Functional Management
- Partner closely with Product, Growth, Marketing, Design, Data Science, Analytics, and Engineering.
- Serve as the central point of coordination for experimentation across the lifecycleentry/exit flows.
- Communicate insights clearly to both technical and executive audiences.
- Create scalable documentation and experiment tracking processes., * Impact: Your work will directly shape how millions of users begin and end their relationship with Paramounts streaming products.
- Ownership: You will define the experimentation engine for some of our most critical user journeys.
- Influence: Work alongside senior ML leaders and help establish how personalization and growth intersect across the company.
- Scale: Paramount is investing heavily in foundational AI and experimentation infrastructure this is an opportunity to build systems that operate at global streaming scale.
Paramount Streaming, a division within Paramount Global, is the home to the company’s direct-to-consumer services spanning free and paid in the form of Pluto TV and Paramount+. Pluto TV is the global leader in free ad-supported TV, delivering more than 1,400 global channels and an extensive library of streaming content, including live and original channels. Paramount+, digital subscription video-on-demand and live streaming service, combines live sports, breaking news, and A Mountain of Entertainment. Paramount+ features an expansive library of original series, hit shows and popular movies across every genre from world-renowned brands and production studios, including SHOWTIME.
Requirements
- 35+ years of experience in experimentation, growth, product analytics, appliedML, or related quantitative roles.
- Proven track record designing and executing high-impact A/B tests in high-scaleconsumer digital products.
- Deep fluency in experimentation methodology: statistical inference, poweranalysis, guardrails, sequential testing, causal reasoning.
- Experience working closely with ML-driven systems (recommendation, ranking,personalization) in production environments.
- Strong analytical toolkit (SQL required; Python/R preferred).
- Ability to debug experiment integrity issues (logging, targeting, traffic splits,instrumentation gaps).
- Strong product intuition and ability to translate ambiguous business questions intostructured testable frameworks.
- Excellent stakeholder management skills and executive-level communication., * Experience in subscription businesses, streaming media, or lifecycle optimization.
- Familiarity with experimentation platforms and feature flag systems.
- Background in growth, pricing optimization, offer testing, or churn reduction strategies.
- Experience working in ML-first or AI-driven product environments.
Benefits & conditions
Hiring Salary Range: $156,800.00 - 235,200.00.
The hiring salary range for this position applies to New York, California, Colorado, Washington state, and most other geographies. Starting pay for the successful applicant depends on a variety of job-related factors, including but not limited to geographic location, market demands, experience, training, and education. The benefits available for this position include medical, dental, vision, 401(k) plan, life insurance coverage, disability benefits, tuition assistance program and PTO or, if applicable, as otherwise dictated by the appropriate Collective Bargaining Agreement.This position is bonus eligible., * Attractive compensation and comprehensive benefits packages. Check out our full list of benefits here: https://www.paramount.com/careers/benefits
- Generous paid time off.
- An exciting and fulfilling opportunity to be part of one of Paramounts most dynamic teams.
- Opportunities for both on-site and virtual engagement events.
- Unique opportunities to make meaningful connections and build a vibrant community, both inside and outside the workplace.
- Explore life at Paramount: https://www.paramount.com/careers/life-at-paramount
Paramount is an equal opportunity employer (EOE) including disability/vet.
At Paramount, the spirit of inclusion feeds into everything that we do, on-screen and off. From the programming and movies we create to employee benefits/programs and social impact outreach initiatives, we believe that opportunity, access, resources and rewards should be available to and for the benefit of all. Paramount is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ethnicity, ancestry, religion, creed, sex, national origin, sexual orientation, age, citizenship status, marital status, disability, gender identity, gender expression, and Veteran status.
About the company
WeAreParamount on a mission to unleash the power of content you in?
Weve got the brands, weve got the stars, weve got thepowerto achieve our mission to entertain the planet now all were missing is YOU! Becoming a part of Paramount means joining a team of passionate people who not only recognize the power of content but also enjoy a touch of fun and uniqueness. Together, we co-create moments that matter both for our audiences and our employees and aim to leave a positive mark on culture.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
I Gave a Video Editor More Autonomy Than a Trading Bot. On Purpose.
Dev Digest 119 - ❤️ === ❤️
Highest Paying Tech Companies for Developers