Information Designer II
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
A client with Kforce is seeking an Information Designer II to join the AI Evaluations team in Mountain View, CA. As a conversation designer you would build golden datasets, analyse AI answers at scale and provide insights on quality and accuracy., * Identify and prioritize opportunities to improve customer experiences and drive business goals in conversational products like chatbots and voice assistants
- Develop end-to-end conversation principles, design strategy, playbooks etc and get alignment from stakeholders like engineering and data science
- Build AI skills (Claude Code or similar) for generating golden datasets for AI evaluations
- Perform offline and online AI answer evaluations at scale with LLM-as-a-judge models and human-in-the-loop
- Drive multiple projects with adherence to deadlines, quality and business metrics
Requirements
- Bachelorβs degree; Education or certifications in Interaction Design, HCI, Psychology, Computer Science, Prompt engineering or related field preferred
- 8 years of design experience, with at least 4 years of conversation design experience and 1year working on AI agentic platforms
- Expertise in data analysis, prompt engineering and AI tools to efficiently deliver artefacts like golden datasets, trends in user responses etc
- Knowledge of language modeling and machine learning frameworks (such as NLUs, RAG databases, TensorFlow, PyTorch, or similar).
- Working understanding of code (html, python, xml, regex) in order to create dynamic dialog-flows using Boolean logic and decision frameworks
- Exceptional communication skills, both written and verbal
- Strong leadership skills, with a proven track record of managing stakeholders, mentoring team members and developing talent
- Experience in conducting user research and usability testing, experiment design and data analysis
Benefits & conditions
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforceβs sole discretion unless and until paid and may be modified in its discretion consistent with the law.
About the company
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦