> Markdown version of [/jobs/ext/2894807-remote](https://www.wearedevelopers.com/jobs/ext/2894807-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Remote - **Company:** MAG 24 LLC - **Location:** New York, NY, United States (Remote available) - **Experience:** Expert - **Salary:** $114,400.0 - $156,000.0 - **Contract:** Permanent contract - **Skills:** Training Data, Artificial Intelligence, Data Analysis, Web Platforms, Large Language Models - **Published:** September 14, 2026 - **Apply:** https://www.careerjet.com/jobad/us77894cd256d9b20e321a3b7551ff7b71 ## About the Role * At least 8 years of dedicated professional experience in marketing * Senior-level expertise in brand strategy, growth marketing, performance marketing, campaign strategy, or related areas * Experience working within a recognised consumer brand, agency, technology company, or comparable organisation * Prior hands-on experience evaluating LLM or AI-generated outputs using structured rubrics or scoring criteria * Demonstrable career progression into senior manager, director, vice president, or comparable leadership responsibilities * Strong commercial judgment and the ability to evaluate complex marketing decisions * Excellent written and verbal communication skills * Reliable availability for at least 35 hours per week during weekdays Educational Background * A degree in marketing, business administration, communications, economics, consumer psychology, or a related field is highly relevant * Graduate-level education in marketing, strategy, business, or management may be helpful * Equivalent senior professional experience in brand, growth, or performance marketing may also be considered * Professional training in analytics, market research, digital marketing, or AI evaluation may be valuable Nice to Have * Experience working with globally recognised brands, major agencies, or high-growth technology companies * Background in consumer packaged goods, retail, digital platforms, media, advertising, or e-commerce * Experience creating structured scoring rubrics, evaluation guidelines, or quality frameworks * Familiarity with model training, human-feedback workflows, annotation, or AI quality assurance * Strong understanding of customer research, positioning, acquisition, retention, and marketing measurement * Experience reviewing campaign briefs, strategic plans, creative concepts, or performance reports * Previous collaboration with product, analytics, research, engineering, or data-science teams, * Expected commitment of at least 35 hours per week during weekdays * Competitive rates between $55-$75 per hour depending on expertise and project scope * Prior experience evaluating AI or LLM outputs against structured rubrics is required * Applicants should clearly describe relevant AI evaluation experience in their application * Immediate availability is preferred * Work may include onboarding, specialty calibration, task development, and ongoing quality review * Project scope and duration may be adjusted according to programme requirements and performance ## Description We are sharing a specialised full-time consulting opportunity for US-based senior marketing professionals with deep experience in brand strategy, growth marketing, performance marketing, and structured evaluation of AI-generated content. This role supports a high-impact generative AI initiative focused on improving how advanced models reason about real-world marketing challenges. Selected professionals will design rigorous marketing tasks, evaluate model outputs against structured criteria, develop scoring frameworks, and provide practical feedback grounded in senior-level brand, growth, and campaign experience., Marketing Strategy & Domain Guidance * Guide research and engineering teams on brand strategy, growth marketing, performance marketing, and campaign-planning concepts * Identify gaps in model understanding across customer segmentation, positioning, channel strategy, creative development, and measurement * Apply practical marketing judgment to complex scenarios involving brands, audiences, markets, and commercial objectives * Ensure marketing tasks reflect realistic business decisions and professional standards Marketing Task & Solution Development * Design challenging, domain-relevant tasks grounded in real marketing practice * Write accurate, well-reasoned solutions covering brand, growth, campaign, and performance-marketing scenarios * Develop problems requiring strategic judgment, prioritisation, interpretation of data, and evaluation of trade-offs * Ensure tasks are clear, internally consistent, and suitable for structured assessment AI Output Evaluation * Evaluate AI-generated marketing responses against established rubrics and scoring criteria * Assess correctness, strategic judgment, reasoning quality, relevance, and practical applicability * Compare alternative outputs and identify which response provides the stronger marketing recommendation * Document factual errors, unsupported assumptions, weak strategic logic, and incomplete analysis * Provide clear written feedback that supports improvements in model behaviour Rubric Development & Quality Calibration * Develop and refine evaluation guidelines for brand, growth, campaign, and performance-marketing tasks * Define scoring criteria for strategic quality, commercial judgment, reasoning, and execution feasibility * Participate in calibration activities with other marketing specialists * Collaborate across teams to maintain consistency and accuracy throughout the training data ## Related Videos - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [Fireside Chat: Deep Learning, Deep Impact: Harnessing AI for Language Innovation](https://www.wearedevelopers.com/videos/612-fireside-chat-deep-learning-deep-impact-harnessing-ai-for-language-innovation) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Project Fugu: Extending the web](https://www.wearedevelopers.com/videos/832-project-fugu-extending-the-web) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Exploring 5 Key Applications of AI Abundance with Blockchain Assurance](https://www.wearedevelopers.com/videos/971-exploring-5-key-applications-of-ai-abundance-with-blockchain-assurance) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try) - [How to start an AI project for a good cause and boost your career](https://www.wearedevelopers.com/magazine/15-how-to-start-an-ai-project-for-a-good-cause-and-boost-your-career) - [How to Tell if Something Was Written by ChatGPT](https://www.wearedevelopers.com/magazine/314-how-to-tell-if-something-was-written-by-chatgpt)