TikTok LIVE - AI Data Operation Specialist

About the Team It has seen tremendous growth and becomes the next driver for TikTok global business. It brings joy to users worldwide and creates a new channel for creators to show themselves.

• Quality Operations & Process Excellence:
• Ensure consistent quality benchmarking, policy calibration, and performance analysis across partnership team.
• Support onboarding, training, and operational readiness of new outsource teams in collaboration with cross-functional partners.
• Lead and manage quality evaluation initiatives, generating insights and developing action plans to address performance gaps.
• Handle content reviewing and analysis projects, delivering actionable trends and recommendations to project stakeholders.
• Serve as custodian for quality-related documentation, including SOPs and reference materials, ensuring accuracy and accessibility.
• Identify and implement process improvements, leveraging technology and collaboration to enhance quality and efficiency.
• AI Operations - Model Training & Enhancement:
• Train and fine-tune models using extensive labeled datasets to improve decision-making accuracy and overall performance.
• Support iterative model improvement through reinforcement learning, testing, and data-driven adjustments.
• Prepare, clean, and structure training data to ensure high-quality inputs for model development.
• Collaborate with product teams and algorithm teams by providing examples and insights to identify and address potential gaps in model decision-making.
• Draft, review, and quality-check training content to optimize the synergy between human inputs and AI data.
• Design and craft high-quality, targeted prompts to test the limits and functionalities of AI models (language understanding, reasoning, creativity, and domain-specific tasks).
• Collaborate with cross-functional teams to understand business requirements and translate them into effective prompt strategies that align with product goals.
• Data Analysis & Reporting:
• Analyze moderation and labeling data from multiple queues to derive a process or market-specific trend/correlation.
• Arrange supporting data points for impact analysis and solution planning.
• Own and track all market-specific KPIs and associated reports.
• Represent quality insight and data for the specific market in timely reviews (WBR/MBR) and project connects.

• Bachelor’s degree in Business, Data Science, Computer Science, Information Technology, Communications, or a related field.
• 3+ years of experience in AI data operation, leveraging AI and ML for content quality management, product operations, or a related analytics role, preferably in tech, digital content, or platform moderation environments.
• Proficiency in data analysis and visualization tools such as Excel, Tableau, Power BI, or similar.
• Basic understanding of machine learning concepts and Large Language Models (LLMs).
• Familiarity with dashboard creation and documentation tools.
• Strong ability to analyze complex datasets, identify patterns, and generate actionable insights.
• Strong critical thinking and problem-solving skills, with a proactive approach to identifying and driving process improvements.
• Preferred Qualifications:
• Able to review and analyze potentially sensitive or disturbing content with objectivity, professionalism, and emotional resilience.
• Strong analytical skills with the ability to translate data into actionable insights, influence strategy, and drive impactful solutions.
• Highly adaptable, proactive, and self-motivated, with a proven ability to thrive in fast-paced and constantly evolving environments.
• Solid understanding of machine learning principles, including model evaluation metrics and optimization techniques.
• A deep interest in LLMs, human behavior and user experience is essential. The ideal candidate is an enthusiastic learner who finds engagement with diverse case studies and annotators stimulating.
• Experience as RLHF (Reinforcement learning from human feedback) annotators for leading Al/LLM companies is strongly preferred.

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok’s global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo., Inspiring creativity is at the core of TikTok’s mission. Our innovative product is built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day. We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We’re resilient and embrace challenges as they come. By constantly iterating and fostering an “Always Day 1” mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us., TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.