> Markdown version of [/jobs/ext/3474661-ai-sr-software-engineer](https://www.wearedevelopers.com/jobs/ext/3474661-ai-sr-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI SR Software Engineer

- **Company:** The Client
- **Location:** Boston, MA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Cloud Computing Security, Cloud Engineering, Software Documentation, DevOps, Monitoring of Systems, Machine Learning, Grafana, Infrastructure as Code (IaC), Rate Limiting, Cloudformation, Integration Tests, Infrastructure Automation Frameworks, Cloudwatch, Terraform, Software Version Control, Api Management
- **Published:** September 22, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=b277b7a763567155

## About the Role

* AWS Expertise: Strong experience with AWS services and cloud architecture
 * Infrastructure as Code: Proficiency with IaC tools (Terraform, CloudFormation, CDK, or similar)
 * AI Gateway Experience: Hands-on experience with LiteLLM or similar AI Gateway platforms
 * Demonstrated ability to implement and configure cloud-based infrastructure solutions
 * Experience with API management and gateway technologies
 * Strong documentation and technical writing skills

Nice to Have

 * Security certifications or specialized security experience (AWS Security, cloud security best practices)
 * Experience with AI/ML model deployment and management
 * Knowledge of rate limiting, token management, and API cost optimization
 * Familiarity with observability and monitoring tools (CloudWatch, Grafana)
 * Experience with CI/CD pipelines and DevOps practices

Deliverables

 * Production-ready AI Gateway implementation
 * Complete IaC codebase with version control
 * Comprehensive technical documentation
 * Onboarding guides and operational procedures
 * Post-implementation support through initial rollout period

## Description

Implementation & Configuration

 * Design and implement AI Gateway infrastructure using Infrastructure as Code (IaC)
 * Configure and customize according to our organizational requirements (security and standards)
 * Deploy solution within our AWS environment
 * Conduct comprehensive testing including functional, performance, and integration testing
 * Ensure solution meets security, scalability, and reliability requirements
 * Documentation & Knowledge Transfer
 * Create detailed technical documentation for the implemented solution
 * Develop onboarding guides and operational runbooks
 * Document configuration standards and deployment procedures
 * Provide architecture diagrams and system documentation
 * Rollout Support
 * Support initial production rollout and deployment
 * Provide troubleshooting and issue resolution during launch phase
 * Conduct knowledge transfer sessions with internal teams
 * Assist with early adoption and usage optimization


## Related Videos

- [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better)
- [Monitoring as Code - Managing your dashboards at scale](https://www.wearedevelopers.com/videos/753-monitoring-as-code-managing-your-dashboards-at-scale)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [AI Driven Development](https://www.wearedevelopers.com/videos/100340-ai-driven-development)

## Related Articles

- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)
- [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)