AI Inference (Forward Deployed Engineer)

Baseten, Inc
San Francisco, CA, United States
3 months ago
Apply on welcometothejungle.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
1 year minimum
Compensation
$165,000.0 - $330,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Python (Programming Language) Machine Learning Software Deployment Software Engineering Software Systems Information Technology Machine Learning Operations Software Coding Programming Languages

Job description

  • As a Forward Deployed Engineer at Baseten, you will partner directly with customers to architect, build, and deploy high-scale production AI applications on Baseten’s platform. You’ll own the journey with customers from initial exploration to production deployment, translating ambiguous business goals into reliable, observable services with clear quality, latency, and cost outcomes
  • To be clear, this is an engineering role with hands-on coding and software development that also includes aspects of product management, technical customer success, and pre-sales solution engineering mixed in
  • Develop and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML projects
  • Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing * evaluation * production deployment * monitoring). This involves working with customers’ engineering teams at every stage of the customer journey including: sales, implementation, and expansion
  • Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs so we can rapidly ship well-tested services and outcomes for our customers
  • Optimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack. This includes developing features and PRDs with other engineering and product orgs
  • Own products and customer projects end-to-end, functioning as both an engineer, project manager, and product manager, with a focus on user empathy, project specification, and end-to-end execution
  • Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity
  • Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates

Requirements

Communication skills Team building Python, * This role is a great fit for entrepreneurial engineers who want a front-row view into how modern companies adopt AI at scale and who enjoy working across product, software development, performance engineering, and customer-facing implementations

  • 2+ years of professional work experience in a fast-paced, high-growth environment
  • Bachelor’s, Master’s, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field
  • Strong communication skills, particularly on complex technical topics
  • Experience in building or optimizing AI/ML projects is highly valued
  • Familiarity with AI/ML pipelines and the lifecycle of ML model development and deployment
  • Demonstrated experience with one or more general-purpose programming languages in a production-level environment, with a strong preference for Python

Benefits & conditions

  • Remote-first work environment. The Baseten team is welcome to work from wherever they want; fully remote, in our San Francisco office, or a mix of both. Today, our team (including our founding team) is spread across the United States, Canada, and Armenia. We provide a $1,000 stipend for you to make your home-office comfortable and productive
  • Regular in-person team summits. We get together as a team three times a year to plan, workshop, and most importantly, get to know each other better
  • Unlimited PTO. We ask that everyone take at least 4 weeks of vacation. And we have a company-wide break between Christmas and New Year’s Day
  • Full healthcare coverage. Medical, dental and vision insurance for you and your family
  • Paid parental leave. 16-weeks fully paid parental leave (adoptive and non-birth parents included) and flexibility with schedules while returning to work
  • Company-sponsored 401(k) for you to contribute to
  • Learning and development budget. We encourage you to take classes, attend conferences, and invest in your craft and we’ll cover expenses to make it happen

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on welcometothejungle.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · World Congress 2025

2:33 min

Defining hybrid development and no-code software paradigms

Mark Piller · LIVE

2:36 min

Applying supervised machine learning for practical rule extraction

Katja Träumner

2:36 min

Experiencing Conway's Law in heterogeneous software systems

Michael Jaeger Michael Jaeger · Europe 2026 Virtual

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

1:48 min

Overconfidence and poor secret management in software

Tino Sokic · World Congress 2022

Videos

See all

Related articles

See all