Backend Engineer, LLM Applications - Newton, MA

Kelly Services Inc.
Newton, MA, United States
3 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Compensation
$127,000 - $220,000
Working hours
Regular working hours

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Artificial Intelligence Cloud Computing Computer Programming Distributed Systems Python (Programming Language) Machine Learning Software Engineering Software Organization Large Language Models Reliability of Systems
+8 more
Generative AI Backend Agentic-AI Containerization Kubernetes Evaluation of Large Language Models Golang Microservices

Job description

  • Build APIs and microservices that support LLM workflows and customer experiences
  • Integrate large language models into scalable production systems
  • Develop tooling to evaluate, monitor, and improve AI application performance
  • Partner with product and engineering teams to design new features and capabilities
  • Improve system reliability, scalability, and observability
  • Troubleshoot issues across Back End services, model integrations, and supporting infrastructure
  • Own solutions from architecture and development through deployment and optimization
  • Contribute to technical decisions that influence the future direction of the platform

Requirements

  • 4+ years of Back End software engineering experience
  • Strong programming experience with Python, Go, Java, or similar languages
  • Experience building and maintaining APIs, microservices, and distributed systems
  • Hands-on experience deploying machine learning or LLM-powered applications into production environments
  • Experience designing scalable, reliable Back End architectures
  • Understanding of cloud infrastructure and modern software development practices
  • Experience monitoring and supporting production applications
  • Strong communication and collaboration skills

Desired Skills & Experience

  • Experience working with Generative AI products or platforms
  • Familiarity with LLM evaluation, observability, and monitoring practices
  • Experience with retrieval-augmented generation (RAG), AI agents, or orchestration frameworks
  • Knowledge of containerization and cloud-native technologies
  • Experience in startup or high-growth environments
  • Passion for building customer-facing AI products

Benefits & conditions

  • Competitive base salary up to $220,000
  • Annual performance-based bonus opportunity
  • Hybrid work environment with 3 days onsite per week in Newton, MA
  • Opportunity to join a well-funded startup building cutting-edge AI products
  • High-impact role with significant ownership and visibility
  • Collaborative engineering culture with direct access to leadership
  • Strong growth potential as the organization scales

You will receive the following benefits

  • Medical Insurance
  • Dental Benefits
  • Vision Benefits
  • Flexible Paid Time Off
  • 401(k)
  • Parental Leave
  • Life Insurance
  • Disability Coverage

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…