Backend Engineer, LLM Applications

• Build APIs and microservices that support LLM workflows and customer experiences
• Integrate large language models into scalable production systems
• Develop tooling to evaluate, monitor, and improve AI application performance
• Partner with product and engineering teams to design new features and capabilities
• Improve system reliability, scalability, and observability
• Troubleshoot issues across backend services, model integrations, and supporting infrastructure
• Own solutions from architecture and development through deployment and optimization
• Contribute to technical decisions that influence the future direction of the platform

• 4+ years of backend software engineering experience
• Strong programming experience with Python, Go, Java, or similar languages
• Experience building and maintaining APIs, microservices, and distributed systems
• Hands-on experience deploying machine learning or LLM-powered applications into production environments
• Experience designing scalable, reliable backend architectures
• Understanding of cloud infrastructure and modern software development practices
• Experience monitoring and supporting production applications
• Strong communication and collaboration skills

Desired Skills & Experience

• Experience working with Generative AI products or platforms
• Familiarity with LLM evaluation, observability, and monitoring practices
• Experience with retrieval-augmented generation (RAG), AI agents, or orchestration frameworks
• Knowledge of containerization and cloud-native technologies
• Experience in startup or high-growth environments
• Passion for building customer-facing AI products

• Competitive base salary up to $220,000
• Annual performance-based bonus opportunity
• Hybrid work environment with 3 days onsite per week in Newton, MA
• Opportunity to join a well-funded startup building cutting-edge AI products
• High-impact role with significant ownership and visibility
• Collaborative engineering culture with direct access to leadership
• Strong growth potential as the organization scales

You will receive the following benefits

• Medical Insurance
• Dental Benefits
• Vision Benefits
• Flexible Paid Time Off
• 401(k)
• Parental Leave
• Life Insurance
• Disability Coverage