Remote- Product Analyst III - Context Designer

We are seeking a highly analytical and detail-oriented Product Analyst to act as a “Context Designer” for Client’s voice AI and prompt-driven initiatives. While this is a non-engineering role, it requires a strong technical bent. You will focus on driving use case context development by drafting natural language prompts, configuring conversational flows, and refining business requirements across CDL/Sales, Servicing, and Production/MFD., * Prompt & Flow Design: Act as a “Context Designer” to write, refine, and configure natural language prompts and conversational flows based on defined business logic.

• Requirements Gathering: Collaborate daily with sales, servicing, and fulfillment teams to capture, define, and negotiate business requirements for AI agent interactions.
• Knowledge Base Curation: Review and curate operational PDFs and documentation to provide a verified “Source of Truth” for the RAG Vector Database.
• A/B Testing & Analysis: Execute A/B tests on various prompt configurations and analyze the resulting data to improve accuracy, tone, and resolution rates.
• Evaluation Support: Assist the Product Owner in defining and documenting the “Golden Dataset” of test scenarios to support automated AI evaluations.
• Technical Collaboration: Work alongside platform engineers who manage the underlying technical architecture within the AWS tech stack to ensure successful API handshakes and platform functionality.

• 3-5 years of experience as a Product Analyst, Business Analyst, or similar role (targeting Analyst III level).
• A non-engineer with a strong “technical bent” and the ability to quickly grasp Generative AI concepts (e.g., RAG, LLM orchestration, prompt tuning).
• Solid Financial Services and mortgage industry experience strongly preferred, * Strong Product Analyst/Product Owner background with a technical mindset.
• Experience with Generative AI and conversational AI/voice bot products.
• Experience designing customer-facing AI experiences rather than internal data management tools.
• Comfortable working closely with both business stakeholders and engineering teams.
• Strong skills in prototyping, requirement gathering, backlog management, and roadmap planning.
• Mortgage industry experience is a plus (secondary preference).
• Overall, this is a semi-technical product role with a strong focus on AI product development.