Principal Software Engineer, AI Observability & Evals Platform

Langchain Inc.
San Francisco, CA, United States
15 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$230,000.0 - $270,000.0
Working hours
Regular working hours
Job source

Tech stack

Query Performance Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Code Review Computer Programming Databases Data Systems Python (Programming Language) PostgreSQL
+12 more
Software Architecture Redis TypeScript Datadog Google Cloud ReactJS Large Language Models Reliability of Systems Backend Front End Software Development Vertica Golang

Job description

We’re looking for a Principal/Lead level Software Engineer to join the LangSmith team and help drive the technical direction of the platform. You’ll build across the full stack from backend services and APIs to frontend product surfaces, and you’ll play a central role in shaping how we build: setting engineering standards, mentoring engineers across the team, and making architectural decisions that hold up as we scale. If you’re energized by both hands-on engineering and the multiplier effect of leveling up those around you, this role is built for that., * Lead architectural decisions across our Go, Python, and TypeScript stack, ensuring systems are performant, maintainable, and built to scale

  • Work across the full stack, owning features end-to-end from backend services and APIs through to frontend product experiences
  • Drive tracing, monitoring, and evaluation workflows at scale, with a focus on reliability and query performance across high-volume data
  • Help shape the product roadmap by partnering closely with product and design - not just executing on it

Raise the Bar for the Team

  • Set engineering standards for the team: define patterns, lead code reviews, and establish the foundations others build on
  • Mentor and grow engineers at all levels through code review, design feedback, pairing, and ongoing technical guidance
  • Drive projects from ambiguity to delivery while maintaining high engineering standards and aggressive timelines

Own Reliability and Quality

  • Troubleshoot and resolve production issues with a root-cause mindset, and implement durable fixes
  • Ensure system reliability through strong testing, monitoring, and alerting practices
  • Create and maintain technical documentation, including system design docs and API references

Requirements

  • 10+ years of professional experience in backend or fullstack engineering on highly complex, production systems
  • Strong programming skills across multiple parts of the stack: backend (Python and/or Go) and frontend (TypeScript, React, or similar)
  • Demonstrated experience making and owning architectural decisions, including tradeoffs around data systems, APIs, and service reliability
  • Experience with high-throughput or mission-critical systems, and a proven ability to optimize for performance and reliability
  • Depth in operationalizing technical work - you’ve taken systems from prototype to production and kept them running well at scale

  • Demonstrated track record of mentoring engineers and raising the technical quality of a team, not just the codebase
  • Strong communication skills and comfort operating cross-functionally with product, design, and engineering leadership
  • Customer centricity and an ownership mentality - you care how the product lands, not just how the code reads
  • You exemplify our operating principles

Nice to Have

  • Experience with database systems (Postgres, Redis, ClickHouse) and cloud platforms (AWS, Google Cloud Platform, or Azure)
  • Familiarity with observability tooling, evaluation frameworks, or AI/LLM infrastructure

Benefits & conditions

We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations., Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.

About the company

At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.

With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.

Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.

About the Team

The LangSmith team owns and builds LangChain’s core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, they own this end-to-end. If you want to help define what great AI observability looks like at production scale, this is where that work gets done.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:18 min

Prioritizing communication and structural awareness over strict tool mastery

Liam Hurrel +1 · WWC 2021

1:08 min

Building solutions with open source GoLang infrastructure tools

Jad Wahab · LIVE

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:16 min

Event-driven Golang backend architecture and cloud deployment

Irina Branovic Irina Branovic · WWC Europe 2026

3:42 min

Comparing in-memory and Redis storage for cache scalability

Simone Sanfratello · WWC 2022

Videos

See all

Related articles

See all