> Markdown version of [/jobs/ext/3567683-senior-data-scientist-ii](https://www.wearedevelopers.com/jobs/ext/3567683-senior-data-scientist-ii). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Scientist II

- **Company:** STALEY ENTERPRISES LLC
- **Location:** Raleigh, NC, United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Applications Architecture, Software Applications, Automated Storage and Retrieval Systems, Cloud Computing, Cloud Engineering, Software Code Optimization, Code Review, Continuous Integration, Distributed Systems, Python (Programming Language), Machine Learning, Performance Tuning, Search Technologies, Service-Oriented Architecture, Software Engineering, Apache Solr, Systems Architecture, Data Logging, System Availability, Large Language Models, Prompt Engineering, IT Architecture, Generative AI, Backend, Agentic-AI, AI Platforms, Information Technology, Machine Learning Operations, Api Design, Model Inference, Code Restructuring, Software Version Control, OpenSearch
- **Published:** October 3, 2026
- **Apply:** https://arc.dev/remote-jobs/j/redirect/p3hmz5j8ln

## About the Role

* Bachelor's, Master's, or PhD in Computer Science, Data Science, Machine Learning, Artificial Intelligence, Engineering, or a related quantitative discipline.
 * Strong experience developing and deploying machine learning and Generative AI solutions in production environments.
 * Advanced proficiency in Python with expertise in software development, system design, and code optimization.
 * Deep understanding of Large Language Models (LLMs), prompt engineering, and retrieval-based AI systems.
 * Hands-on experience designing and implementing Retrieval-Augmented Generation (RAG) solutions.
 * Strong software engineering fundamentals including testing, version control, CI/CD, and application architecture.
 * Experience building distributed applications and scalable backend services.
 * Knowledge of monitoring, observability, logging, and production support practices.
 * Experience with API design, integration, and service-oriented architectures.
 * Strong analytical, troubleshooting, and problem-solving skills.
 * Excellent communication and collaboration abilities in cross-functional environments., * Experience developing agentic AI applications and autonomous workflow systems.
 * Familiarity with OpenSearch, Solr, vector search technologies, and semantic retrieval systems.
 * Experience optimizing LLM inference pipelines and production AI architectures.
 * Knowledge of cloud-native AI platforms, distributed computing, and MLOps practices.
 * Experience implementing governance, reliability, and security controls for AI systems.
 * Background working on enterprise-scale or customer-facing AI products.

Key Skills

 * Generative AI
 * Large Language Models (LLMs)
 * Retrieval-Augmented Generation (RAG)
 * Python
 * Machine Learning
 * Data Science
 * Agentic AI Applications
 * Software Engineering
 * Distributed Systems
 * API Design
 * OpenSearch
 * Solr
 * Vector Search
 * Monitoring & Logging
 * Observability
 * Production AI Systems
 * MLOps
 * System Architecture
 * Performance Optimization
 * Cloud Technologies

## Description

We are seeking a Senior Data Scientist II to lead the design, development, and optimization of AI-powered applications that leverage Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and modern machine learning techniques. This role combines data science, software engineering, AI architecture, and platform reliability, requiring ownership of AI solutions from experimentation through production deployment and continuous optimization., * Architect, design, and develop scalable AI-powered applications utilizing Generative AI, machine learning, and retrieval technologies.

 * Build modular agent-based systems and intelligent workflows that support complex business and knowledge-driven use cases.
 * Design and optimize Retrieval-Augmented Generation (RAG) pipelines to improve relevance, accuracy, and performance of AI-powered solutions.
 * Refactor, enhance, and maintain complex Python-based applications to improve scalability, reliability, and maintainability.
 * Develop APIs, services, and backend components that support AI model integration and deployment.
 * Collaborate with product, engineering, and data teams to translate business requirements into production-ready AI solutions.
 * Ensure production readiness through rigorous testing, monitoring, logging, and observability practices.
 * Optimize model inference, retrieval workflows, and system performance across distributed environments.
 * Establish metrics, dashboards, and monitoring frameworks to track application health, model quality, and operational performance.
 * Support deployment, lifecycle management, and continuous improvement of AI and machine learning systems.
 * Drive software engineering best practices including code reviews, testing automation, documentation, and architectural governance.
 * Evaluate emerging AI technologies and recommend innovative solutions to enhance platform capabilities.