> Markdown version of [/jobs/ext/165594-data-scientist](https://www.wearedevelopers.com/jobs/ext/165594-data-scientist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Scientist - **Company:** Zywave, Inc. - **Location:** United States (Remote available) - **Contract:** Permanent contract - **Skills:** A/B Testing, Artificial Intelligence, Data Analysis, Automation of Tests, Information Engineering, Data Visualization, Data Warehousing, Relational Databases, Database Queries, Statistical Hypothesis Testing, Python (Programming Language), Knowledge Management, Machine Learning, Regression Analysis, NumPy, SQL Databases, Tableau (Software), Feature Engineering, Large Language Models, Git, Pandas, Matplotlib, Scikit Learn, Machine Learning Operations, Looker Analytics, Software Version Control, Data Pipelines - **Published:** May 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=8ebb87b0666c5e6d ## About the Role * Strong foundation in statistics and experimental design-you understand A/B testing, hypothesis testing, and can properly analyze experiment results. * Hands-on experience with machine learning fundamentals, including model training, evaluation, and feature engineering. * Proficiency in Python and the data science stack (pandas, scikit-learn, NumPy, matplotlib/seaborn). * Strong SQL skills and experience working with relational databases and data warehouses. * Experience building data pipelines or working with workflow orchestration tools. * Familiarity with version control (Git) and collaborative software development practices. * Strong analytical and problem-solving skills with attention to detail. * Good communication skills-you can explain technical concepts clearly and create compelling visualizations. * Self-motivated with the ability to manage multiple tasks and priorities effectively. * (Preferred) Exposure to generative AI, LLM evaluation, or working with AI/ML products in production. * (Preferred) Experience with data visualization tools (Tableau, Looker, or similar). ## Description At Zywave, we believe in building AI systems that are reliable, measurable, and continuously improving. The Data Scientist will work within our AI Engineering and Data Science team to execute and operationalize our evaluation framework for ML/AI models. This role is hands-on and execution-focused, requiring strong technical skills in statistical analysis, and production ML workflows. You'll implement evaluation pipelines, run experiments, and conduct analyses that ensure our AI systems meet quality standards and drive measurable business impact. What you will do: Evaluation Framework Execution * Implement and operationalize evaluation pipelines for agentic AI models based on established frameworks and methodologies. * Execute benchmark tests, collect performance metrics, and generate evaluation reports. * Maintain and improve automated testing suites that assess model performance across multiple dimensions. * Monitor evaluation results and flag performance issues or anomalies for investigation. Experimentation & A/B Testing * Execute A/B tests and experiments according to designed protocols, ensuring proper implementation and data collection. * Conduct statistical analysis of experiment results, including hypothesis testing, confidence intervals, and effect size calculations. * Create clear, actionable reports that communicate experiment findings to stakeholders. * Support the design of new experiments by providing data-driven insights and feasibility assessments. Traditional ML & Statistical Analysis * Build and maintain classical machine learning models to support business analytics and decision-making. * Conduct exploratory data analysis to uncover insights and patterns in product usage and model performance data. * Perform statistical analyses including regression analysis, time series forecasting, and cohort analysis. * Develop predictive models for business metrics, user behavior, and model performance trends. Data Workflows & Pipeline Management * Build and maintain data pipelines that support evaluation workflows, analytics, and reporting. * Ensure data quality through validation checks, monitoring, and documentation. * Work with data engineering teams to optimize data collection and storage for evaluation needs. * Create and maintain SQL queries, transformations, and data models. Monitoring & Reporting * Develop and maintain dashboards that track model performance, experiment results, and key metrics. * Create automated reporting that provides visibility into AI system health and business impact. * Support incident response by analyzing data to identify root causes of performance issues. * Document processes, methodologies, and findings to build organizational knowledge. ## Related Videos - [Python Data Visualization @ Deepnote (w/ PyViz overview)](https://www.wearedevelopers.com/videos/113-python-data-visualization-deepnote-w-pyviz-overview) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.](https://www.wearedevelopers.com/videos/562-vectorize-all-the-things-using-linear-algebra-and-numpy-to-make-your-python-code-lightning-fast) - [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript) - [Getting to Know Your Legacy (System) with AI-Driven Software Archeology](https://www.wearedevelopers.com/videos/1437-getting-to-know-your-legacy-system-with-ai-driven-software-archeology) - [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)