Sr Data Scientist- Conversational AI & NLU

Description The Senior Data Scientist - Conversational AI & NLU is responsible for designing, developing, evaluating, and optimizing conversational AI solutions across chat and voice channels. This role focuses on GenAI-driven conversational experiences, agentic multi-turn conversations, and rigorous evaluation of NLU and LLM-based systems, while serving as a primary interface between business stakeholders and data science delivery teams.Key ResponsibilitiesDesign, develop, and optimize GenAI-powered conversational AI solutions using advanced prompting strategies, structured evaluation frameworks, continuous monitoring, and solution performance reportingBuild and improve agentic, multi-turn conversational experiences with robust context management, memory strategies, and conversation state handlingOwn experimentation and evaluation of NLU, LLM, and conversational AI solutions, including hypothesis definition, metric design, error analysis, and recommendation of targeted improvementsAct as the primary data science partner to business stakeholders by gathering requirements, clarifying objectives, translating needs into actionable analytical and modeling tasks, and driving execution to measurable outcomesAssign, coordinate, review, and provide technical guidance on work delivered by onshore and offshore data scientists, ensuring analytical rigor, consistency, and timely deliverySupport end-to-end delivery of conversational AI and NLU capabilities for IVR and chat solutions, including intent understanding, entity extraction, dialogue flows, and conversational quality assessmentAnalyze conversation data such as chat logs, call transcripts, and speech-to-text outputs to identify gaps, failure modes, and optimization opportunities across user journeysDefine and report solution-level KPIs related to conversation success, containment, task completion, accuracy, customer effort, and overall experience qualityEnsure conversational AI solutions align with enterprise standards, governance, and regulatory expectations, particularly in highly regulated environmentsRequired QualificationsMaster's or Ph.D. in Computer Science, Data Science, Machine Learning, or a related quantitative field5+ years of experience in data science, with at least 3+ years focused on conversational AI, NLU, or NLP-driven systemsStrong programming and analytical skills in Python, applied primarily to modeling, experimentation, and evaluationHands-on experience with LLM Evaluation frameworks like RAGAS, DeepEval, LangSmith, etc.Proven ability to design, run, interpret, and communicate the results of NLU and conversational AI experiments, translating insights into concrete model and conversation improvementsExperience supporting text- and voice-based, multi-turn, actionable conversational experiences within contact center or customer-facing platformsStrong communication skills with demonstrated ability to explain complex analytical concepts to technical and non-technical stakeholdersPreferred QualificationsHands-on experience with Amazon Connect, Amazon Bedrock, or Amazon LexPractical experience applying LLMs and GenAI techniques to conversational or customer experience use casesFamiliarity with IVR analytics, conversational logging frameworks, call transcripts, and speech-to-text data analysisExperience working in banking, financial services, or other regulated enterprise environmentsHours & Work ScheduleHours per Week: 40Work Schedule: Monday - FridayHybrid: 4 days per week onsite, 1 day remote Pay TransparencyThe salary range for this position is $124,000 - $165,000 per year, plus an opportunity to earn an annual discretionary bonus. Actual pay is based on various factors including but not limited to the work location, and relevant skills and experience.We offer competitive pay, comprehensive medical, dental and vision coverage, retirement benefits, maternity/paternity leave, flexible work arrangements, education reimbursement, wellness programs and more. Note, Citizens' paid time off policy exceeds the mandatory, paid sick or paid time-away policy of every local and state jurisdiction in the United States. For an overview of our benefits, visit https://jobs.citizensbank.com/benefits . Some job boards have started using jobseeker-reported data to estimate salary ranges for roles. If you apply and qualify for this role, a recruiter will discuss accurate pay guidance. Equal Employment OpportunityCitizens, its parent, subsidiaries, and related companies (Citizens) provide equal employment and advancement opportunities to all colleagues and applicants for employment without regard to age, ancestry, color, citizenship, physical or mental disability, perceived disability or history or record of a disability, ethnicity, gender, gender identity or expression, genetic information, genetic characteristic, marital or domestic partner status, victim of domestic violence, family status/parenthood, medical condition, military or veteran status, national origin, pregnancy/childbirth/lactation, colleague's or a dependent's reproductive health decision making, race, religion, sex, sexual orientation, or any other category protected by federal, state and/or local laws. At Citizens, we are committed to fostering an inclusive culture that enables all colleagues to bring their best selves to work every day and everyone is expected to be treated with respect and professionalism. Employment decisions are based solely on merit, qualifications, performance and

data science partner to business stakeholders by gathering requirements, clarifying objectives, translating needs into actionable analytical and modeling tasks, and driving execution to measurable outcomesAssign, coordinate, review, and provide technical guidance on work delivered by onshore and offshore data scientists, ensuring analytical rigor, consistency, and timely deliverySupport end-to-end delivery of conversational AI and NLU capabilities for IVR and chat solutions, including intent understanding, entity extraction, dialogue flows, and conversational quality assessmentAnalyze conversation data such as chat logs, call transcripts, and speech-to-text outputs to identify gaps, failure modes, and optimization opportunities across user journeysDefine and report solution-level KPIs related to conversation success, containment, task completion, accuracy, customer effort, and overall experience qualityEnsure conversational AI solutions align with enterprise standards, governance, and regulatory expectations, particularly in highly regulated environmentsRequired QualificationsMaster's or Ph.D. in Computer Science, Data Science, Machine Learning, or a related quantitative field5+ years of experience in data science, with at least 3+ years focused on conversational AI, NLU, or NLP-driven systemsStrong programming and analytical skills in Python, applied primarily to modeling, experimentation, and evaluationHands-on experience with LLM Evaluation frameworks like RAGAS, DeepEval, LangSmith, etc.Proven ability to design, run, interpret, and communicate the results of NLU and conversational AI experiments, translating insights into concrete model and conversation improvementsExperience supporting text- and voice-based, multi-turn, actionable conversational experiences within contact center or customer-facing platformsStrong communication skills with demonstrated ability to explain complex analytical concepts to technical and non-technical stakeholdersPreferred

QualificationsHands-on experience with Amazon Connect, Amazon Bedrock, or Amazon LexPractical experience applying LLMs and GenAI techniques to conversational or customer experience use casesFamiliarity with IVR analytics, conversational logging frameworks, call transcripts, and speech-to-text data analysisExperience working in banking, financial services, or other regulated enterprise environmentsHours & Work ScheduleHours per Week: 40Work Schedule: Monday - FridayHybrid: 4 days per week onsite, 1 day remote Pay TransparencyThe salary range for this position is $124,000 - $165,000 per year, plus an opportunity to earn an annual discretionary bonus. Actual pay is based on various factors including but not limited to the work location, and relevant skills and experience.We offer competitive pay, comprehensive medical, dental and vision coverage, retirement benefits, maternity/paternity leave, flexible work arrangements, education reimbursement, wellness programs and more. Note, Citizens' paid time off policy exceeds the mandatory, paid sick or paid time-away policy of every local and state jurisdiction in the United States. For an overview of our benefits, visit https://jobs.citizensbank.com/benefits . Some job boards have started using jobseeker-reported data to estimate salary ranges for roles. If you apply and qualify for this role, a recruiter will discuss accurate pay guidance. Equal Employment OpportunityCitizens, its parent, subsidiaries, and related companies (Citizens) provide equal employment and advancement opportunities to all colleagues and applicants for employment without regard to age, ancestry, color, citizenship, physical or mental disability, perceived disability or history or record of a disability, ethnicity, gender, gender identity or expression, genetic information, genetic characteristic, marital or domestic partner status, victim of domestic violence, family status/parenthood, medical condition, military or veteran status, national aaaaa is pregnancy/childbirth/lactation, colleague's or a dependent's reproductive health decision making, race, religion, sex, sexual orientation, or any other category protected by federal, state and/or local laws. At Citizens, we are committed to fostering an inclusive culture that enables all colleagues to bring their best selves to work every day and everyone is expected to be treated with respect and professionalism. Employment decisions are based solely on merit, qualifications, performance and