> Markdown version of [/jobs/ext/2081609-experimentation-lead-sign-up-and-cancellation-optimization](https://www.wearedevelopers.com/jobs/ext/2081609-experimentation-lead-sign-up-and-cancellation-optimization). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Experimentation Lead, Sign-Up and Cancellation Optimization - **Company:** Paramount Pictures - **Location:** Burbank, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** A/B Testing, Artificial Intelligence, Data Analysis, Software Debugging, Python (Programming Language), Machine Learning, SQL Databases, Data Streaming, Usage Analysis, Data Logging, Model-Driven Development, Power Analysis (Cryptography), Data Analytics - **Published:** August 16, 2026 - **Apply:** https://www.jobmonkeyjobs.com/career/27939461/Experimentation-Lead-Sign-Up-Cancellation-Optimization-California-Burbank-1517 ## About the Role * 3-5+ years of experience in experimentation, growth, product analytics, applied ML, or related quantitative roles. * Proven track record designing and executing high-impact A/B tests in high-scale consumer digital products. * Deep fluency in experimentation methodology: statistical inference, power analysis, guardrails, sequential testing, causal reasoning. * Experience working closely with ML-driven systems (recommendation, ranking, personalization) in production environments. * Strong analytical toolkit (SQL required; Python/R preferred). * Ability to debug experiment integrity issues (logging, targeting, traffic splits, instrumentation gaps). * Strong product intuition and ability to translate ambiguous business questions into structured testable frameworks. * Excellent stakeholder management skills and executive-level communication., * Experience in subscription businesses, streaming media, or lifecycle optimization. * Familiarity with experimentation platforms and feature flag systems. * Background in growth, pricing optimization, offer testing, or churn reduction strategies. * Experience working in ML-first or AI-driven product environments. ## Description Paramount Streaming is investing heavily in personalization, experimentation, and applied AI to shape how millions of viewers begin - and continue - their journey with Paramount+ and Pluto TV. We are seeking an Experimentation Lead to own and scale experimentation across the sign-up and cancellation flows. This is a highly strategic and execution-oriented role focused on identifying, prioritizing, launching, and scaling experiments that directly impact conversion, retention, and lifetime value. Reporting to the Principal Machine Learning Engineer for Sign-Up Optimization, you will act as the connective tissue between product, ML, engineering, data science, design, and growth - ensuring we are running the right experiments, running them well, and learning from them rigorously. This role blends product thinking, scientific rigor, experimentation design, and operational management. What You'll Do Experimentation Strategy & Roadmapping * Define and own the experimentation roadmap across sign-up, onboarding, and cancellation flows for Paramount+ and Pluto TV. * Identify high-impact test opportunities across UX, messaging, offers, personalization, pricing, bundling, and model-driven experiences. * Translate business goals (conversion, churn reduction, engagement, LTV) into structured, testable hypotheses. * Prioritize experiments using data-driven frameworks balancing impact, risk, and resource constraints. End-to-End Experiment Ownership * Drive experiments from ideation * design * instrumentation * launch * feedback * iteration. * Partner with ML engineers and applied scientists to test model-driven experiences (ranking, personalization, content ordering, offer targeting). * Ensure experiment configurations are correctly implemented and debug issues in targeting, logging, or exposure. * Monitor live experiments for integrity, guardrail breaches, or unintended side effects. * Lead post-test readouts and translate results into clear, actionable next steps. Scientific Rigor & Measurement * Design robust A/B, multivariate, and sequential testing frameworks. * Define primary metrics, guardrails, and success criteria aligned to long-term value, not just short-term conversion. * Improve offline-to-online validation practices in partnership with ML teams. * Standardize experimentation best practices across the Applied Intelligence group. * Champion causal reasoning and statistical discipline in decision-making. Cross-Functional Management * Partner closely with Product, Growth, Marketing, Design, Data Science, Analytics, and Engineering. * Serve as the central point of coordination for experimentation across the lifecycle entry/exit flows. * Communicate insights clearly to both technical and executive audiences. * Create scalable documentation and experiment tracking processes., * Impact: Your work will directly shape how millions of users begin and end their relationship with Paramount's streaming products. * Ownership: You will define the experimentation engine for some of our most critical user journeys. * Influence: Work alongside senior ML leaders and help establish how personalization and growth intersect across the company. * Scale: Paramount is investing heavily in foundational AI and experimentation infrastructure - this is an opportunity to build systems that operate at global streaming scale. ## Related Videos - [The Innovation Formula: Fast Prototyping, Data Analysis, and Real User Insights](https://www.wearedevelopers.com/videos/1421-the-innovation-formula-fast-prototyping-data-analysis-and-real-user-insights) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Bringing the power of AI to your application.](https://www.wearedevelopers.com/videos/1010-bringing-the-power-of-ai-to-your-application) - [Crypto-secure Data Management with In-Database Blockchain](https://www.wearedevelopers.com/videos/632-crypto-secure-data-management-with-in-database-blockchain) - [How We Built a Machine Learning-Based Recommendation System (And Survived to Tell the Tale)](https://www.wearedevelopers.com/videos/752-how-we-built-a-machine-learning-based-recommendation-system-and-survived-to-tell-the-tale) - [Developers Communities in San Francisco - WeAreDevelopers LIVE from Corgi Cafe](https://www.wearedevelopers.com/videos/2144-developers-communities-in-san-francisco-wearedevelopers-live-from-corgi-cafe) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Prompt Engineering is a Job of the Past](https://www.wearedevelopers.com/magazine/342-prompt-engineering-is-a-job-of-the-past) - [Dev Digest 130 - The Diablo is in the details](https://www.wearedevelopers.com/magazine/470-dev-digest-130-the-diablo-is-in-the-details)