> Markdown version of [/jobs/ext/4788718-domain-consultant-united-states](https://www.wearedevelopers.com/jobs/ext/4788718-domain-consultant-united-states). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Domain Consultant - United States - **Company:** PERSISTENT - **Location:** Santa Clara, CA, United States - **Contract:** Permanent contract - **Skills:** Microsoft Excel, Artificial Intelligence, Information Systems, Python (Programming Language), Natural Language Processing, Performance Tuning, SQL Databases, Large Language Models, Agentic-AI, TurboTax, Information Technology, Data Analytics, Gsuite, Data Pipelines - **Published:** November 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=5c64f2dc313ee6ef ## About the Role * Strong proficiency in Python. * BA or BS degree in relevant fields such as English, Communications, Linguistics, Business, Data Analytics, Computer Science, or Information Systems. * 1-3 years of experience in support, customer service, or content design QA. * Ability to evaluate conversations from multiple perspectives and identify areas for improvement. * Excellent analytical skills with experience using Microsoft Excel or Google Sheets, SQL, and Python for data analysis. * Effective verbal and written communication skills. * Detail-oriented with a high level of accuracy. * Proven experience in resolving complex customer issues and managing escalations. * Flexible and adaptable to work in a rapidly evolving environment. Preferred Skills * Experience in a financial institution or other highly regulated environment. * Familiarity with CRM and QA platforms. * Spanish fluency is a plus. Expertise You'll Bring * Ability to design and create diverse evaluators, rubrics, and prompts tailored to specific AI tasks. * Innovative mindset for generating effective prompts that enhance model performance. * Experience in conducting research to curate relevant data sources for evaluator development. * Commitment to staying up-to-date with advancements in natural language processing and AI technologies. ## Description As an Artificial Intelligence Data Quality Specialist, you will play a crucial role in ensuring the quality and effectiveness of Intuit AI capabilities, particularly our innovative agentic experiences designed to assist TurboTax members. Your expertise in Python will be essential as you investigate AI quality issues, evaluate agentic traces and conversations, and collaborate with cross-functional stakeholders to enhance response accuracy and quality. What You'll Do * Evaluate AI conversations and agent traces across various TurboTax experiences, identifying trends, errors, and member frustrations. * Label data as needed with specific outcomes and generate synthetic datasets for evaluations. * Collaborate with cross-functional stakeholders to identify gaps and other issues affecting AI performance. * Serve as a resource for improving responses in AI agents, including LLM judge and rubric generation. * Analyze qualitative and quantitative data to identify patterns in member satisfaction and dissatisfaction. * Participate in ?audit the auditor? programs and calibration sessions to ensure inter-labeler alignment. * Investigate non-natural language patterns, including anomalies in conversation distributions and sentiment. * Engage in additional services, data pipelines, and trained models to discover quality opportunities. * Perform other assigned tasks as needed to fulfill the role.