Software Engineer

LRS Consulting is on the hunt for a Software Engineer responsible for building platform infrastructure, developer tools, and distributed systems.

Responsibilities

• Design and build core platform components including provider abstractions, structured output validation, streaming systems, and token management.

• Own safety and compliance systems such as guardrails, PII detection and redaction, audit logging, and privacy focused observability.

• Build evaluation tooling for LLM output quality, including datasets, scoring methods, CI integration, and regression detection.

• Develop provider adapters and SDK architecture that shield teams from frequent LLM provider and SDK changes.

• Build and maintain prompt lifecycle tools including versioning, reviews, and deployment workflows.

• Design infrastructure for long running asynchronous agents using AWS services.

• Work closely with internal teams to understand needs, support onboarding, and provide technical guidance.

• 8 years of software engineering experience with significant time in platform infrastructure, developer tools, SDKs, or distributed systems.

• Production experience with LLM or AI systems and familiarity with challenges such as token limits, provider outages, and model updates.

• Strong TypeScript skills and experience designing clean, intuitive APIs.

• Knowledge of AI safety, PII handling, auditing, and responsible use practices.

• Experience with event driven systems and asynchronous processing.

• Understanding of observability for distributed systems including metrics, tracing, and alerting.

• Strong communication and technical writing skills.

• Proven technical leadership experience.

• Experience with cloud platforms, ideally AWS.

Preferred Skills

• Experience building SDKs or platforms used by multiple teams.

• Experience with prompt engineering or LLM evaluation tools.

• Familiarity with TypeScript backend frameworks such as NestJS or Prisma.

• Experience with streaming systems for real time AI features.

• Background in multi tenant platform design.

• Experience with ports and adapters or similar architectural patterns.

• Contributions to AI or LLM open source projects.

The base range for this direct hire position is $160,000 - $185,000 per year, depending on experience.

Our pay ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hires of this position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.