Senior Data Scientist

Cloudera, Inc.
Palo Alto, United States
1 day ago
Apply on arc.dev
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Automated Storage and Retrieval Systems Code Review Data Cleansing Data Infrastructure Relational Databases Github Iterative and Incremental Development Python (Programming Language) Machine Learning NumPy Cloudera
+19 more
SQL Databases Systems Integration Workflow Management Systems Enterprise Software Applications Feature Engineering Large Language Models Prompt Engineering Generative AI Jupyter Fastapi Pandas AI Platforms Core Data Scikit Learn Information Technology Api Design Streamlit Framework Software Version Control Unsupervised Learning

Job description

You will apply rigorous analytical thinking and modern AI capabilities to design, build, and scale high-impact solutions.

  • Design, develop, and deploy GenAI-powered internal applications, copilots, and workflow accelerators.
  • Build reusable AI components, including retrieval pipelines, structured prompting patterns, orchestration workflows, and evaluation harnesses.
  • Design retrieval strategies that connect LLMs to trusted internal knowledge sources, ensuring grounded and reliable outputs.
  • Develop and maintain statistical and machine learning models to support automation, optimization, forecasting, and classification use cases.
  • Implement evaluation and validation frameworks to measure quality, accuracy, and consistency of AI-driven systems.
  • Partner cross-functionally to identify high-value opportunities for AI enablement across the organization.
  • Create reusable datasets, feature pipelines, and experimentation frameworks to support iterative development.
  • Uphold high standards for quality, reliability, and responsible AI practices.
  • Contribute to peer review processes to ensure technical rigor and maintainability.
  • Document methodologies, assumptions, and implementation details to ensure transparency and reproducibility.

Requirements

To succeed in this role, you will demonstrate technical depth, intellectual curiosity, and a strong builder mindset:

  • Generative AI & LLM Engineering: Hands-on experience working with large language models (LLMs) and modern AI tooling. This includes prompt design, structured output generation, retrieval-augmented generation (RAG), evaluation strategies, and workflow automation. Ability to translate GenAI capabilities into reliable, enterprise-ready solutions that integrate with existing systems and data sources.
  • AI Application Development Experience: rapidly prototyping and iterating on internal applications, copilots, or AI-enabled workflow tools. Comfortable evolving prototypes into maintainable, production-grade solutions. Familiarity with modern development frameworks (e.g., Streamlit, Gradio, FastAPI, or similar) is beneficial.
  • Platform-Oriented Thinking: Demonstrated ability to design reusable components such as shared prompt libraries, retrieval pipelines, evaluation frameworks, and standardized integration patterns that enable scalable AI adoption.
  • Data Science & Machine Learning Expertise: Proficiency in Python (or R) for data preparation, feature engineering, statistical modeling, and machine learning. Experience with core data science libraries (e.g., Pandas, NumPy, scikit-learn) and a solid understanding of supervised and unsupervised learning methods.
  • Strong Mathematical and Statistical Foundation: Deep understanding of probability, statistical inference, experimentation, and quantitative reasoning to ensure model robustness and reliability.
  • SQL & Data Fluency: Strong understanding of relational databases and the ability to quickly learn new schemas and data environments. Comfortable writing efficient, production-grade SQL to support modeling, experimentation, and AI-enabled applications.
  • Exceptional Communication Skills: Ability to translate complex business challenges into technical solutions and clearly communicate findings, trade-offs, and recommendations to both technical and non-technical stakeholders.
  • Collaborative Development Experience: Experience working in collaborative environments such as Cloudera Data Science Workbench, Jupyter, Zeppelin, or similar platforms.
  • GitHub Proficiency: Experience using version control to support collaboration, code review, documentation, and long-term maintainability., * Hands-on experience building applications or workflows powered by large language models (LLMs).
  • Evidence of a builder mindset through shipped AI tools, internal platforms, or automation solutions.
  • Demonstrated experience applying machine learning techniques in production or enterprise environments.
  • 5+ years of relevant experience in Data Science, Machine Learning, or AI-focused roles.
  • Strong curiosity for emerging AI technologies and the ability to evaluate and adopt them responsibly.
  • Academic background in a quantitative discipline such as Statistics, Mathematics, Computer Science, Engineering, Economics, or a related field.

You may also have: (Preferred Qualifications)

  • Experience with vector databases, embedding models, or semantic retrieval systems.
  • Experience designing internal AI platforms or shared enablement frameworks.
  • Familiarity with API-driven architectures and integrating AI capabilities into enterprise systems.
  • Exposure to responsible AI practices, governance frameworks, or model lifecycle management.

Benefits & conditions

  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups

About the company

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we’re the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

At Cloudera, we believe that data can make what is impossible today, possible tomorrow. We empower organizations to transform complex data into clear and actionable outcomes. Join us in our mission to harness the power of data.

We are seeking a talented and curious Senior Data Scientist to join our fast-paced, data-driven organization. In this role, you will design and deliver AI-powered systems and applications that accelerate decision-making and enhance operational excellence.

You will combine strong statistical foundations, advanced programming expertise, and modern Generative AI techniques to build scalable, production-ready solutions. This is a builder-focused role. You will move beyond analysis to develop internal copilots, AI-enabled workflows, and reusable platform components that embed intelligence directly into business processes.

Our work empowers leadership and operational teams by creating measurable, AI-enabled capabilities. We seek a thoughtful and pragmatic innovator who is enthusiastic about GenAI, disciplined experimentation, and building durable internal AI infrastructure.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on arc.dev
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:34 min

Maximizing execution memory effectively via python numpy broadcasting

Jodie Burchell · LIVE

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:25 min

Replacing NumPy with cuPy for straightforward GPU acceleration

Paul Graham Paul Graham · World Congress 2025

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

Videos

See all

Related articles

See all