Remote

MAG 24 LLC
New York, NY, United States
7 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$114,400.0 - $156,000.0
Working hours
Regular working hours

Tech stack

Training Data Artificial Intelligence Data Analysis Web Platforms Large Language Models

Job description

We are sharing a specialised full-time consulting opportunity for US-based senior marketing professionals with deep experience in brand strategy, growth marketing, performance marketing, and structured evaluation of AI-generated content. This role supports a high-impact generative AI initiative focused on improving how advanced models reason about real-world marketing challenges. Selected professionals will design rigorous marketing tasks, evaluate model outputs against structured criteria, develop scoring frameworks, and provide practical feedback grounded in senior-level brand, growth, and campaign experience., Marketing Strategy & Domain Guidance

  • Guide research and engineering teams on brand strategy, growth marketing, performance marketing, and campaign-planning concepts
  • Identify gaps in model understanding across customer segmentation, positioning, channel strategy, creative development, and measurement
  • Apply practical marketing judgment to complex scenarios involving brands, audiences, markets, and commercial objectives
  • Ensure marketing tasks reflect realistic business decisions and professional standards

Marketing Task & Solution Development

  • Design challenging, domain-relevant tasks grounded in real marketing practice
  • Write accurate, well-reasoned solutions covering brand, growth, campaign, and performance-marketing scenarios
  • Develop problems requiring strategic judgment, prioritisation, interpretation of data, and evaluation of trade-offs
  • Ensure tasks are clear, internally consistent, and suitable for structured assessment

AI Output Evaluation

  • Evaluate AI-generated marketing responses against established rubrics and scoring criteria
  • Assess correctness, strategic judgment, reasoning quality, relevance, and practical applicability
  • Compare alternative outputs and identify which response provides the stronger marketing recommendation
  • Document factual errors, unsupported assumptions, weak strategic logic, and incomplete analysis
  • Provide clear written feedback that supports improvements in model behaviour

Rubric Development & Quality Calibration

  • Develop and refine evaluation guidelines for brand, growth, campaign, and performance-marketing tasks
  • Define scoring criteria for strategic quality, commercial judgment, reasoning, and execution feasibility
  • Participate in calibration activities with other marketing specialists
  • Collaborate across teams to maintain consistency and accuracy throughout the training data

Requirements

  • At least 8 years of dedicated professional experience in marketing
  • Senior-level expertise in brand strategy, growth marketing, performance marketing, campaign strategy, or related areas
  • Experience working within a recognised consumer brand, agency, technology company, or comparable organisation
  • Prior hands-on experience evaluating LLM or AI-generated outputs using structured rubrics or scoring criteria
  • Demonstrable career progression into senior manager, director, vice president, or comparable leadership responsibilities
  • Strong commercial judgment and the ability to evaluate complex marketing decisions
  • Excellent written and verbal communication skills
  • Reliable availability for at least 35 hours per week during weekdays

Educational Background

  • A degree in marketing, business administration, communications, economics, consumer psychology, or a related field is highly relevant
  • Graduate-level education in marketing, strategy, business, or management may be helpful
  • Equivalent senior professional experience in brand, growth, or performance marketing may also be considered
  • Professional training in analytics, market research, digital marketing, or AI evaluation may be valuable

Nice to Have

  • Experience working with globally recognised brands, major agencies, or high-growth technology companies
  • Background in consumer packaged goods, retail, digital platforms, media, advertising, or e-commerce
  • Experience creating structured scoring rubrics, evaluation guidelines, or quality frameworks
  • Familiarity with model training, human-feedback workflows, annotation, or AI quality assurance
  • Strong understanding of customer research, positioning, acquisition, retention, and marketing measurement
  • Experience reviewing campaign briefs, strategic plans, creative concepts, or performance reports
  • Previous collaboration with product, analytics, research, engineering, or data-science teams, * Expected commitment of at least 35 hours per week during weekdays
  • Competitive rates between $55-$75 per hour depending on expertise and project scope
  • Prior experience evaluating AI or LLM outputs against structured rubrics is required
  • Applicants should clearly describe relevant AI evaluation experience in their application
  • Immediate availability is preferred
  • Work may include onboarding, specialty calibration, task development, and ongoing quality review
  • Project scope and duration may be adjusted according to programme requirements and performance

Benefits & conditions

Why This Opportunity

  • Apply senior marketing expertise to an advanced generative AI initiative
  • Influence how AI systems reason about brand, growth, and campaign strategy
  • Design and assess challenging marketing problems grounded in practical commercial experience
  • Collaborate with technical teams and experienced marketing specialists
  • Join a full-time remote engagement with competitive hourly compensation

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:59 min

Building culturally aware LLMs for global audiences

Werner Vogels Werner Vogels +1 · World Congress 2026 Europe

2:20 min

Architecting language translation with focused training data

Jaroslaw Kutylowski Jaroslaw Kutylowski +1 · World Congress 2023

1:48 min

Automating exploratory data analysis within training pipelines

Dora Petrella · World Congress 2023

2:31 min

Web platform advancements and shared technological ecosystems

Nico Martin · LIVE

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

2:25 min

Meta's investment in Scale AI and training data

Damandeep Kochhar Damandeep Kochhar +4 · World Congress 2026 Europe

Videos

See all

Related articles

See all