> Markdown version of [/jobs/ext/3050454-software-engineer-ai-llms](https://www.wearedevelopers.com/jobs/ext/3050454-software-engineer-ai-llms). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer (AI / LLMs) - **Company:** APIPHANI, INC. - **Location:** Boston, MA, United States (Remote available) - **Experience:** Expert - **Salary:** $120,000.0 - $160,000.0 - **Contract:** Permanent contract - **Skills:** Clean Code Principles, Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Amazon S3, Cloud Computing, Cloud Engineering, Code Review, Continuous Integration, Data Security, DevOps, Distributed Systems, Github, Information Technology Operations, Python (Programming Language), PostgreSQL, Open Source Technology, Search Technologies, SQL Databases, Systems Integration, TypeScript, Datadog, AWS Cdk, Retrieval-Augmented Generation, Large Language Models, Multi-Agent Systems, Generative AI, Backend, Event Driven Architecture, Infrastructure Automation Frameworks, Machine Learning Operations, Virtual Agents, Cloudwatch, Terraform, Dynatrace, Automation Anywhere, Docker, Microservices - **Published:** September 24, 2026 - **Apply:** https://www.juju.com/job/16_854798555 ## About the Role * 6+ years of backend engineering experience in production environments * Strong proficiency in Python and TypeScript for building distributed, event-driven systems * Deep understanding of AWS services (Lambda, ECS, Bedrock, S3, CloudWatch, etc.) * Experience designing APIs, microservices, and event pipelines that interface with LLMs or AI models * Familiarity with vector databases and concepts like embeddings, similarity search, and retrieval-augmented generation * Experience with infrastructure-as-code tools such as Terraform or AWS CDK * Understanding of SQL and schema migration workflows (PostgreSQL or similar) * Hands-on experience with Docker, GitHub Actions, and cloud-native CI/CD workflows * Ability to diagram systems, communicate architecture decisions clearly, and work asynchronously in a distributed team * Strong sense of ownership and ability to deliver in fast-moving, ambiguous environments Bonus Points * Experience working with LangChain, OpenAI, or Anthropic APIs * Familiarity with agentic frameworks or AI orchestration systems * Background in observability or APM tooling (e.g., Datadog, Dynatrace) * Prior experience building automation or infrastructure management tools * Contributions to open-source LLM or MLOps projects * Interest in shaping how AI is applied to real-world IT operations ## Description Apiphani is building the future of intelligent infrastructure automation through agentic AI. We're looking for a Senior Backend Engineer to help design and build the systems that power Luumen - an AI-driven automation platform used by enterprise IT and managed service providers around the world. This is a high-impact, zero-to-one engineering role focused on building the backend foundations for large-scale AI orchestration. You'll work on distributed systems that combine traditional infrastructure automation with large language models (LLMs), retrieval-augmented generation (RAG), and intelligent agents. What You'll Do * Design and implement backend services that enable intelligent agent workflows and autonomous infrastructure actions * Develop APIs and orchestration layers in Python and TypeScript, integrating LLMs, vector databases, and observability pipelines * Build scalable systems to support LLM-based reasoning, retrieval, and decision-making across cloud infrastructure * Integrate with AWS Bedrock and other LLM platforms to support multi-model capabilities * Develop data access and semantic search layers using vector databases (e.g., pgvector, Pinecone, Qdrant) * Build robust monitoring, testing, and CI/CD systems to ensure reliability and reproducibility of AI workflows * Collaborate closely with the product and DevOps teams to design architecture diagrams, plan deployments, and monitor system health * Write clean, maintainable code with clear documentation and strong adherence to security and performance best practices * Participate in code reviews, design discussions, and iterative delivery cycles to improve product velocity and quality ## Related Videos - [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Building AI Applications with LangChain and Node.js](https://www.wearedevelopers.com/videos/1512-building-ai-applications-with-langchain-and-node-js) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)