Information Designer II: 26-03441

This role focuses on improving the quality and accuracy of AI-powered chatbots and voice assistants. You will design conversational experiences, build golden datasets, evaluate AI-generated responses at scale, and provide insights to improve AI performance., Build AI skills using Claude Code or similar tools to generate golden datasets. Evaluate AI responses using LLM-as-a-Judge models and human feedback. Analyze AI answer quality, accuracy, and customer experience trends. Partner with Engineering and Data Science teams to drive improvements.

Artificial Intelligence (AI), Data Analysis, Data Sets, Conversation Engine, Quality Management, Performance Management, Analysis Skills, Customer Experience, Data Science, Process Improvement, 8+ years of design experience, including 4+ years in Conversation Design. 1+ year of experience with AI agentic platforms. Strong expertise in prompt engineering, AI tools, and data analysis. Understanding of LLMs, NLP/NLU, RAG, or machine learning frameworks. Working knowledge of Python, HTML, XML, Regex, or similar coding languages., Experience in conversational AI, chatbots, voice assistants, AI evaluation, or generative AI products is preferred.

Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Inc’s Best Workplaces 2024 and Silicon Valley’s Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor’s Best Places to Work (2023 & 2022)!

Industry Leaders in IT Staffing As staffing solutions providers for Fortune 100 companies, Akraya’s industry recognitions solidify our leadership position in the IT staffing space. We don’t just connect you with great jobs, we connect you with a workplace that inspires!

Join Akraya Today! Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!