> Markdown version of [/jobs/ext/2591096-telecommute-ai-architect-remote](https://www.wearedevelopers.com/jobs/ext/2591096-telecommute-ai-architect-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # TELECOMMUTE AI Architect - Remote - **Company:** Lightning Minds Inc. - **Location:** United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** A/B Testing, Artificial Intelligence, Amazon Web Services, Automated Storage and Retrieval Systems, Microsoft Azure, Software as a Service, Cloud Computing Security, Computer Programming, Databases, Data Centers, Disaster Recovery, Distributed Systems, Failover, Identity and Access Management, Python (Programming Language), Lua (Scripting Language), Routing, Open Source Technology, Ping (Networking Utility), Release Management, Systems Integration, AI Infrastructure, Private Cloud Environment, Datadog, Data Logging, Pulumi, Flexi (Photoshop Plugin), Google Cloud, Load Balancing, System Availability, Large Language Models, Multi-Agent Systems, IT Architecture, Multi-Cloud, Caching, HybridCloud, Rate Limiting, Event Driven Architecture, AI Platforms, Infrastructure Automation Frameworks, Low Latency, Deployment Automation, Machine Learning Operations, Api Design, Terraform, Splunk, Software Version Control, Dynatrace, Microservices - **Published:** August 29, 2026 - **Apply:** https://www.dice.com/job-detail/76234b2f-048c-45e1-adde-c99fe889f7de ## About the Role * 8+ years of experience in software/solutions architecture, with 3+ years focused on AI/ML systems. * Proven hands-on experience architecting agentic AI systems multi-agent frameworks, autonomous workflows, tool/function calling, and orchestration. * Strong expertise in hybrid and multi-cloud architecture (AWS, Azure, Google Cloud Platform, and on-premises/private cloud integration). * Demonstrated experience designing or implementing an AI Gateway / LLM Gateway(e.g., Kong, custom-built gateways) for managing multi-model access, routing, rate limiting, and observability. * Deep understanding of LLM ecosystems (OpenAI, Anthropic, open-source models) and model serving infrastructure. * Experience with RAG architectures, vector databases (e.g.Milvus, pgvector), and knowledge retrieval systems. * Solid grounding in API design, microservices, event-driven architecture, and distributed systems. * Strong knowledge of cloud security, IAM, networking, and compliance frameworks across multi-cloud environments (IDPs like EntraID and Ping. * Proficiency with infrastructure-as-code (Terraform/Harness, DeclarativeKong), CI/CD pipelines, and observability tooling (Splunk, DynaTrace). * Programming proficiency in Python (required). ## Description Architecture & Design * Design end-to-end architecture for agentic AI systems (multi-agent orchestration, tool-use frameworks, memory/state management, planning and reasoning loops) deployed across hybrid and multi-cloud environments. * Architect and implement an AI Gateway layer to unify access to multiple LLM/model providers (OpenAI, Anthropic, Google, open-source models, self-hosted models) with centralized routing, rate limiting, load balancing, caching, and failover. * Define reference architectures for hybrid cloud AI deployments, balancing workloads across on-prem, private cloud, and public cloud (AWS/Azure/Google Cloud Platform) based on data residency, latency, cost, and compliance requirements. * Establish patterns for model orchestration, agent-to-agent communication, and tool/function calling across distributed systems. * Design for interoperability across cloud-native AI services (Bedrock, Azure AI Foundry, Microsoft Co-pilot) * Integrating MCP Registry, governance of Agent Registry * Microsoft EntraID as identity provider for MCP authentication * Integrating AI gateway with AWS Valkey cache and other vector / RAG databases * Specific implementation experience of Kong AI gateway with plug-in based architecture, ability create plug-ins using Lua script or Python * Observability integration with Dynatrace for agents and AI gateway telemetry; Splunk integration for audit logs AI Gateway & Governance * Own the strategy and implementation of the AI Gateway as the control plane for all AI/LLM traffic including authentication, authorization, usage metering, cost governance, PII/data redaction, prompt/response logging, and audit trails. * Implement guardrails for model governance: version control, A/B testing, fallback routing, semantic caching, and observability across multiple model providers. * Define policies for responsible AI, data privacy, and security across the gateway and agentic workflows, ensuring compliance with regulatory frameworks (GDPR, SOC 2, HIPAA, etc. as applicable). Multi-Cloud & Infrastructure * Architect resilient, scalable, and cost-optimized infrastructure spanning multiple cloud providers and on-prem data centers. * Drive infrastructure-as-code practices (Terraform, Pulumi) for consistent multi-cloud provisioning of AI/ML infrastructure. * Evaluate and integrate vector databases, feature stores, and RAG pipelines across hybrid environments. * Ensure high availability, disaster recovery, and business continuity for mission-critical agentic AI applications. Leadership & Collaboration * Partner with engineering, product, security, and data teams to align AI architecture with business objectives. * Provide technical leadership and mentorship to AI/ML engineers and platform teams. * Evaluate emerging tools, frameworks, and vendors in the agentic AI and AI infrastructure ecosystem (e.g., MCP Registry, Kong AI Gateway, Agent365). * Create architecture documentation, design standards, and best practices to guide organization-wide AI adoption. * Act as a trusted advisor to leadership on AI platform strategy, build-vs-buy decisions, and technology roadmaps. * Setup Operating model to operate and govern AI gateway usage enterprise-wide * Scalability, hosting topology, define centralized vs federated model * Deployment architecture, change management, release management and incident management * Alignment with United AI governance Framework for agentic systems * Integrate skills, tools, MCP servers - internal or SaaS vendor source ## Related Videos - [Why segmenting your infrastructure into tiers makes your infrastructure design better](https://www.wearedevelopers.com/videos/1960-why-segmenting-your-infrastructure-into-tiers-makes-your-infrastructure-design-better) - [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture) - [Creating a routing app with Google Maps API from scratch](https://www.wearedevelopers.com/videos/831-creating-a-routing-app-with-google-maps-api-from-scratch) - [Agentic employees in world's most downloaded FinTech app](https://www.wearedevelopers.com/videos/100123-agentic-employees-in-world-s-most-downloaded-fintech-app) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Unleashing Potential Across Teams: The Power of Infrastructure as Code](https://www.wearedevelopers.com/videos/930-unleashing-potential-across-teams-the-power-of-infrastructure-as-code) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)