Lead Data Scientist - AI Engineer

William Blair
Chicago, IL, United States
13 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Airflow Data Analysis Microsoft Azure Cloud Computing Software Quality Code Review Communications Protocols Continuous Delivery Continuous Integration Data Cleansing
+26 more
Data Governance Design of User Interfaces Human-Computer Interaction Machine Learning Language Modeling Rapid Prototyping Process Reliability Engineering Salesforce.Com Software Engineering Data Streaming Workflow Management Systems Feature Engineering Retrieval-Augmented Generation Large Language Models Multi-Agent Systems Prompt Engineering Apache Spark Software Application Programming Build Management Salesforce Object Query Language (SOQL) Build Tools Data Management Machine Learning Operations Restful APIs Data Pipelines Databricks

Job description

You will set the engineering standards for the team: architecture decisions, code quality, testing practices, and deployment patterns. You will work across the full stack-from data pipelines and ML models to LLM orchestration and Salesforce integrations-with the options to choose the right tool for each problem and the discipline to build for longevity., * Design and build the integration layer between Enterprise Claude, Salesforce CRM, and our proprietary ML models, creating the orchestration backbone for AI-powered banking workflows.

  • Develop AI agents and multi-step LLM applications for high-value use cases: CIP first-draft generation, buyer landscape analysis, intelligent process letter drafting, and deal status automation.
  • Set engineering standards for the Innovation Team: code review practices, CI/CD pipelines, testing frameworks, and documentation norms that enable speed without sacrificing reliability.
  • Work directly with deal teams and industry/sector groups to understand workflows, identify automation opportunities, and iterate on deployed tools based on real-world banker feedback.
  • Build and maintain data pipelines using Databricks and Dagster for feature engineering, model training, and analytics that feed AI capabilities.
  • Perform rapid analysis and prototyping-translate a banker’s pain point into a working proof of concept within days, not weeks.
  • Evaluate and integrate point solutions (Rogo.ai, Blueflame AI, Fellow.ai) via APIs, ensuring clean data flows and consistent user experiences within Salesforce.
  • Implement security and data governance protocols appropriate for confidential deal information.

Requirements

  • 5+ years of software engineering experience with a strong full-stack foundation, including production experience building applications that serve demanding end users.
  • Hands-on experience building applications or agents using large language models: prompt engineering, retrieval-augmented generation, multi-step orchestration, tool use, and evaluation frameworks.
  • Experience deploying and operating multi-agent ecosystems in production - including reliability engineering, monitoring, failure recovery, and scaling agent infrastructure for enterprise workloads.
  • Strong ML fundamentals-ability to train, evaluate, and deploy models, perform exploratory data analysis, and build feature pipelines.
  • Rigorous engineering practices: you write tested, reviewed, well-documented code and build systems designed for maintainability, not just demos.
  • Familiarity with capital markets, and preferably direct experience in or adjacent to investment banking, private equity, venture capital, or hedge funds.
  • Experience with cloud infrastructure (Azure preferred), data platforms (Databricks/Spark), and orchestration tools (Dagster, Airflow, or equivalent).
  • Outcome orientation-you measure success by business impact delivered, not features shipped.

PREFERRED QUALIFICATIONS

  • Experience in a Forward Deployed Engineer, solutions engineer, or embedded technical role where you owned outcomes alongside business stakeholders.
  • Prior work with Salesforce APIs, SOQL, or CRM integration patterns.
  • Experience architecting production-grade, interconnected multi-agent ecosystems - designing agent coordination patterns, shared tooling layers, and communication protocols across autonomous components.
  • Experience building AI tools for financial professionals, including document generation, financial analysis automation, or deal workflow tooling.
  • Contributions to engineering culture: mentoring, establishing best practices, or leading technical design reviews in a small-team environment.

LI-CH, Analysis Skills, Application Programming Interface (API), Artificial Intelligence (AI), Artificial Intelligence (AI) Agents, Automation, Bank Management, Banking Services, Best Practices, CRM Integration, Capital Markets, Cloud Computing, Code Reviews, Communications Protocols, Continuous Deployment/Delivery, Continuous Integration, Customer Relationship Management (CRM), Data Analysis, Data Cleaning, Data Management, Data Science, Documentation, Ecosystems, Embedded Systems, Financial Analysis, Financial Services, Hedge Funds, Investment Services, Machine Tool, Mentoring, Microsoft Windows Azure, Modeling Languages, Private Banking, Product Demonstration, Proof of Concept, Purchasing/Procurement, Quality Assurance Methodology, Rapid Prototyping, Reliability Engineering, Salesforce.com, Systems Maintainability, Team Player, Technical Leadership, Technical/Engineering Design, Test Plan/Schedule, Testing, Training/Teaching, Use Cases, User Interface/Experience (UI/UX), Venture Capital

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

48 sec

Exploring alternative build tools and experimental web components

Sasha Shynkevich · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:09 min

Configuring IDEs and build tools for Java 17

Daniel Strmečki · LIVE

Videos

See all

Related articles

See all