> Markdown version of [/jobs/ext/4726323-backend-engineer-llm-applications-newton-ma](https://www.wearedevelopers.com/jobs/ext/4726323-backend-engineer-llm-applications-newton-ma). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Backend Engineer, LLM Applications - Newton, MA - **Company:** Kelly Services Inc. - **Location:** Newton, MA, United States - **Experience:** Experienced - **Salary:** $127,000 - $220,000 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Cloud Computing, Computer Programming, Distributed Systems, Python (Programming Language), Machine Learning, Software Engineering, Software Organization, Large Language Models, Reliability of Systems, Generative AI, Backend, Agentic-AI, Containerization, Kubernetes, Evaluation of Large Language Models, Golang, Microservices - **Published:** November 15, 2026 - **Apply:** https://www.careerboard.com/us/en/find-jobs-in-United-States/-6B49B365809C36CFBE/ ## About the Role * 4+ years of Back End software engineering experience * Strong programming experience with Python, Go, Java, or similar languages * Experience building and maintaining APIs, microservices, and distributed systems * Hands-on experience deploying machine learning or LLM-powered applications into production environments * Experience designing scalable, reliable Back End architectures * Understanding of cloud infrastructure and modern software development practices * Experience monitoring and supporting production applications * Strong communication and collaboration skills Desired Skills & Experience * Experience working with Generative AI products or platforms * Familiarity with LLM evaluation, observability, and monitoring practices * Experience with retrieval-augmented generation (RAG), AI agents, or orchestration frameworks * Knowledge of containerization and cloud-native technologies * Experience in startup or high-growth environments * Passion for building customer-facing AI products ## Description * Build APIs and microservices that support LLM workflows and customer experiences * Integrate large language models into scalable production systems * Develop tooling to evaluate, monitor, and improve AI application performance * Partner with product and engineering teams to design new features and capabilities * Improve system reliability, scalability, and observability * Troubleshoot issues across Back End services, model integrations, and supporting infrastructure * Own solutions from architecture and development through deployment and optimization * Contribute to technical decisions that influence the future direction of the platform