> Markdown version of [/jobs/ext/1753867-ai-systems-design-architect](https://www.wearedevelopers.com/jobs/ext/1753867-ai-systems-design-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Systems Design Architect - **Company:** State Street - **Location:** United States - **Experience:** Expert - **Salary:** $90,000.0 - $157,500.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Computing Platforms, Microsoft Azure, Cloud Computing, Cloud Engineering, Distributed Systems, Identity and Access Management, Interoperability, Machine Learning, Azure Machine Learning, Data Streaming, Systems Integration, Software Technical Review, Data Processing, Google Cloud, Enterprise Software Applications, Large Language Models, Model Validation, Generative AI, Event Driven Architecture, AI Platforms, Information Technology, Machine Learning Operations, Api Design, Devsecops, Serverless Computing, Microservices - **Published:** July 25, 2026 - **Apply:** https://www.dice.com/job-detail/c0bce2ab-9918-4083-8256-373dc374bd03 ## About the Role * Bachelor's degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline; Master's degree preferred. * 8-14 years of experience in solution architecture, enterprise application architecture, platform architecture, or AI/ML architecture. * Strong hands-on experience with Generative AI, LLMs, ML systems, RAG architectures, vector databases, and AI application integration. * Proven experience in cloud architecture and solution design on at least one major cloud platform: AWS, Azure, or Google Cloud Platform (Google Cloud Platform). * Strong understanding of cloud-native services including compute, storage, networking, identity and access management, security, and AI/ML services. * Expertise in API architecture, microservices, distributed systems, event-driven architecture, and system integration patterns. * Experience designing solutions with strong security, resiliency, scalability, observability, and performance considerations. * Working knowledge of AI governance, Responsible AI, model risk, compliance, testing, and operational controls. * Ability to lead architecture discussions and clearly communicate complex technical concepts to technical and business stakeholders. * Strong collaboration, problem-solving, and stakeholder management skills. ## Description We are seeking an AI System Design Architect (AVP) with strong expertise in Generative AI, Machine Learning, enterprise architecture, cloud platforms, and scalable solution design. This role will own end-to-end system design for a major GenAI platform and shared AI services, ensuring solutions are secure, resilient, compliant, and aligned with enterprise architecture standards. The ideal candidate will translate business and platform requirements into robust technical architectures across the AI stack, define architecture patterns and integration contracts, establish non-functional requirements, and provide architecture reviews across pods. This role requires close collaboration with product, engineering, data science, cloud, and control teams to drive scalable, production-grade AI solutions., * Own end-to-end architecture and system design for a major AI platform domain, including model integration, orchestration, APIs, data flows, and downstream system interactions. * Define and implement reference architectures, design standards, integration contracts, and non-functional requirements (NFRs) for the platform area. * Translate business and product requirements into scalable, secure, resilient, and maintainable AI solution designs. * Partner with business stakeholders, product managers, engineers, data scientists, platform teams, and security teams to deliver enterprise-ready AI systems. * Design solutions leveraging cloud architecture principles on AWS, Azure, or Google Cloud, ensuring interoperability, scalability, observability, and operational readiness. * Establish reusable architecture patterns for RAG, model serving, prompt workflows, agentic AI workflows, and AI application integration. * Ensure alignment with Responsible AI, model governance, data handling, compliance, testing, risk, and production control requirements. * Conduct architecture assessments, technical design reviews, and proof-of-concept evaluations for new AI use cases and platform capabilities. * Review solution designs across pods and provide guidance on architecture decisions, trade-offs, and standards adherence. * Partner with engineering and DevSecOps teams to support production readiness, release architecture, monitoring, and scalability planning. ## Related Videos - [Inside the AI Revolution: How Microsoft is Empowering the World to Achieve More](https://www.wearedevelopers.com/videos/869-inside-the-ai-revolution-how-microsoft-is-empowering-the-world-to-achieve-more) - [This App Reached 10,000 Users in One Week. Here's How.](https://www.wearedevelopers.com/videos/100329-this-app-reached-10-000-users-in-one-week-here-s-how) - [API Design - Getting Started](https://www.wearedevelopers.com/videos/33-api-design-getting-started) - [DevSecOps: Injecting Security into Mobile CI/CD Pipelines](https://www.wearedevelopers.com/videos/273-devsecops-injecting-security-into-mobile-ci-cd-pipelines) - [Beyond GPT: Building Unified GenAI Platforms for the Enterprise of Tomorrow](https://www.wearedevelopers.com/videos/1525-beyond-gpt-building-unified-genai-platforms-for-the-enterprise-of-tomorrow) - [From AI Assistance to Agentic Systems: Scaling Sovereign AI in Banking](https://www.wearedevelopers.com/videos/100070-from-ai-assistance-to-agentic-systems-scaling-sovereign-ai-in-banking) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)