> Markdown version of [/jobs/ext/3530567-full-stack-development](https://www.wearedevelopers.com/jobs/ext/3530567-full-stack-development). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Full Stack Development - **Company:** CareerCircle - **Location:** New York, NY, United States (Remote available) - **Salary:** $78,000.0 - **Contract:** Temporary contract - **Skills:** Artificial Intelligence, Language Modeling, Large Language Models - **Published:** October 2, 2026 - **Apply:** https://www.careercircle.com/jobs/all/all/usa/ny/new-york/7db7b5e2-221d-4e68-b68b-362d54e099f0 ## About the Role A creative advertising, media, marketing, or copywriting -Experience evaluating advertising content and creative quality An understanding of: Brand voice and brand guidelines Marketing messaging Creative writing principles Ad copy effectiveness The ability to make nuanced judgments on subjective areas such as: Creativity Diversity of language Repetitive copy patterns, Copywriting, Editing, Brand Voice, Brand Guidelines, Advertising, Short form copy, advertising copy, evaluation, copy editing, quality assurance, creativity, journalism, editorial Job Type & Location, Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors. ## Description Editing Marketing Operations Creativity Journalism Copywriting Copy Editing Brand Management Quality Assurance Business Valuation Full Stack Development Large Language Modeling Business Transformation, The client is working to enhance creative advertising within their originals programming. We are looking to create a golden data set for AI generated ad copy for various advertisers looking for placements within Amazon originals. In this role you will be responsible for evaluating advertising copy generated by a large language model (LLM) to ensure that it meets their benchmark in quality, structure, brand voice adherence, brand guidelines, and contextual relevance between the advertise brand and content. Responsibilities include: -Ad copy annotation and quality review of generated advertising copy. -Evaluating copy against an existing Amazon-provided rubric, while also providing feedback and recommendations to improve that rubric. -Creating and validating golden datasets and benchmark annotation sets to support quality measurement and future model development. -Performing copy rewrites when necessary, with rewrites confirmed as in scope -Providing recommendations to improve creative generation quality, variety, and consistency Assessing: Copy quality and effectiveness Brand voice adherence