> Markdown version of [/jobs/ext/2569252-ai-software-engineer-iii](https://www.wearedevelopers.com/jobs/ext/2569252-ai-software-engineer-iii). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Software Engineer III

- **Company:** Boston, Inc.
- **Location:** Marlborough, MA, United States
- **Salary:** $82,100.0 - $156,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Audit Trail, Microsoft Azure, Cloud Engineering, Data Architecture, Data Infrastructure, Software Design Patterns, Monitoring of Systems, RabbitMQ, Redis, Regression Testing, Systems Integration, Retrieval-Augmented Generation, Multi-Agent Systems, Prompt Engineering, AI Platforms, Information Technology, Apache Kafka, Machine Learning Operations, Celery, Virtual Agents, Amazon Simple Queue Service (SQS)
- **Published:** August 11, 2026
- **Apply:** https://jobs.localjobnetwork.com/apply/add/87995870/1

## About the Role

* Bachelor's or master's degree in computer science, engineering, data science or a related technical field.
 * Proven experience designing and deploying large language model-based solutions, including retrieval-augmented generation, prompt engineering and model integration.
 * Experience creating human and automated evaluations to help ensure high AI model quality.
 * Deep experience with asynchronous processing and distributed task queues, such as Celery, Kafka, SQS, RabbitMQ or Redis.
 * Experience designing and building robust APIs.
 * Ability to operate with a high degree of autonomy, navigate ambiguity and thrive in a fast-moving, startup-like environment.
 * Demonstrated curiosity and commitment to learning and staying current in the rapidly evolving AI field.
 * Strong understanding of cloud-native architectures in Azure and/or AWS and modern data platforms., * Proven experience with agentic AI frameworks such as LangGraph, Semantic Kernel, AutoGen, CrewAI or similar technologies.
 * Familiarity with vector databases, embedding strategies and search optimization techniques.
 * Hands-on experience with MLOps/LLMOps, including model monitoring, evaluation and lifecycle management.
 * Proven experience defining reference architectures, design patterns and reusable AI platforms.

## Description

* Design modular and reusable AI components and services that can be leveraged across multiple platforms and business use cases.
 * Design end-to-end, multi-agent workflows with tool routing, human approvals, audit trails and safe action boundaries.
 * Design data architecture for operational AI systems, including ingestion, schemas, quality checks and governance.
 * Build evaluations, monitoring, metrics and regression tests for agentic workflows.
 * Ensure solutions are designed for performance, reliability, observability and operational excellence.
 * Contribute to a culture of ownership, experimentation and customer-centric product thinking.


## Related Videos

- [Celery on AWS ECS - the art of background tasks & continuous deployment](https://www.wearedevelopers.com/videos/561-celery-on-aws-ecs-the-art-of-background-tasks-continuous-deployment)
- [Engineering Mindset in the Age of AI - Gunnar Grosch, AWS](https://www.wearedevelopers.com/videos/1735-engineering-mindset-in-the-age-of-ai-gunnar-grosch-aws)
- [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis)
- [Beyond Kafka & RabbitMQ: Why NATS is the Future of Microservices Messaging](https://www.wearedevelopers.com/videos/1646-beyond-kafka-rabbitmq-why-nats-is-the-future-of-microservices-messaging)
- [Developing ASP.NET Core Microservices with Dapr: A practical guide](https://www.wearedevelopers.com/videos/1528-developing-asp-net-core-microservices-with-dapr-a-practical-guide)
- [Accelerating Authentication Architecture: Taking Passwordless to the Next Level](https://www.wearedevelopers.com/videos/733-accelerating-authentication-architecture-taking-passwordless-to-the-next-level)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)