Senior AI Architect - Azure & Cloud AI

IBM
Chicago, IL, United States
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Continuous Integration Data Infrastructure Data Integration Software Design Patterns Memory Management Azure Machine Learning Enterprise Data Management
+12 more
Enterprise Software Applications Azure Data Factory Large Language Models Multi-Agent Systems Prompt Engineering IT Architecture Microsoft Fabric Operational Systems Machine Learning Operations Virtual Agents Azure Synapse Analytics Software Version Control

Job description

We are seeking an AI Architect to join our growing AI practice on a high-visibility enterprise engagement. This is a senior, client-facing role where you will provide thought leadership and define the technical direction across a complex, multi-workstream AI program. The client expects a seasoned professional who can hit the ground running - shaping strategy, establishing architecture standards, and driving alignment between business objectives and AI capabilities.

You will be the go-to technical authority for end-to-end Azure AI architecture, ensuring that every solution is scalable, secure, governed, and aligned to real business value.

What You’ll Do

Thought Leadership & Technical Direction

  • Serve as the senior technical voice on the engagement, setting the architectural vision and ensuring consistency across workstreams

  • Define and govern end-to-end Azure AI architecture spanning Azure OpenAI, Azure Machine Learning, and enterprise data platforms

  • Develop reference architectures, patterns, and reusable assets that accelerate delivery and elevate the practice

  • Mentor and upskill team members on Azure AI best practices, design patterns, and emerging capabilities

Client Engagement & Solution Architecture

  • Lead architecture design sessions and workshops with client stakeholders to align on strategy and technical approach

  • Translate complex business requirements into scalable, secure, and maintainable AI-powered solutions

  • Map AI use cases to measurable business value, ensuring enterprise standards and governance are embedded from the start

  • Present architectural recommendations with clarity and confidence to both technical and executive audiences

Technical Delivery

  • Architect and oversee implementation of AI solutions across Azure OpenAI, Azure ML, and supporting data infrastructure

  • Establish design standards for model deployment, prompt engineering, data integration, and AI observability

  • Establish a scalable operating model for AI industrialization by standardizing deployment, monitoring, governance, and support processes across existing AI solutions to improve reliability, reuse, and speed to value

  • Leverage Model Context Protocols (MCPs) to enable secure, modular integration between agents, enterprise systems, and data sources, creating a more interoperable and extensible agentic AI ecosystem

  • Implement orchestration and guardrail frameworks for agentic workflows to ensure AI agents can collaborate effectively, access the right contextual information, and operate with appropriate oversight, auditability, and human-in-the-loop controls

  • Ensure all solutions adhere to enterprise security, compliance, and reliability requirements

  • Collaborate closely with data, engineering, and business teams to ensure successful end-to-end delivery

Required technical and professional expertise

  • 8+ years of experience leading the implementation of enterprise-grade AI and agentic AI solutions across cloud and hybrid environments.

  • Design scalable AI platforms leveraging Azure and AWS services, including secure model deployment, orchestration, monitoring, and governance.

  • Build and operationalize LLM-powered applications using frameworks such as LangChain and LangGraph.

  • Define agentic architectures including multi-agent orchestration, tool calling, memory management, MCP integration patterns, and human-in-the-loop controls.

  • Establish best practices for AI industrialization, including CI/CD, model lifecycle management, observability, prompt/version management, evaluation frameworks, and guardrails.

  • Integrate AI systems with enterprise applications, APIs, vector databases, workflow platforms, and operational systems.

  • Collaborate with business, data, security, and engineering teams to translate business requirements into scalable AI architectures.

  • Provide technical leadership across architecture reviews, platform strategy, vendor selection, and AI governance initiatives.

Requirements

Preferred technical and professional experience

Preferred Skills

  • Familiarity with agentic AI frameworks (e.g., LangChain, AutoGen, Semantic Kernel) and RAG architectures

  • Experience with Azure data services including Azure Synapse, Azure Data Factory, or Microsoft Fabric

  • Knowledge of AI governance, responsible AI practices, and enterprise security considerations

  • Azure certifications (e.g., Azure Solutions Architect Expert, Azure AI Engineer Associate)

About the company

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:21 min

Navigating the ethical integration of virtual colleagues

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

1:28 min

Documenting microservice architectures with the architecture canvas

Benjamin Wolf Benjamin Wolf +1 · WWC 2025

2:27 min

Introduction to WebAssembly in a cloud computing context

Edo Edo · WWC 2024

1:13 min

Managing AI development with Azure AI Foundry

Ricardo Ricardo · WWC 2025

40 sec

Empowering automated workflows with agentic AI models

Mike Mike · WWC 2025

1:34 min

Transitioning from traditional software development to artificial intelligence consulting

Patrick Schnell Patrick Schnell · Coffee With Developers

Videos

See all

Related articles

See all