GenAI Ops Solution Architect

System One
Pittsburgh, PA, United States
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Application Frameworks Computing Platforms Audit Trail Microsoft Azure Cloud Engineering Software Design Patterns Distributed Systems Monitoring of Systems Cloud Services
+12 more
Enterprise Application Integration Large Language Models Prompt Engineering Generative AI Event Driven Architecture Information Technology Deployment Automation Data Management Machine Learning Operations Virtual Agents Cloud Integration Microservices

Job description

GenAI Ops Solution Architect who will lead the design, governance, and evolution of enterprise-scale Generative AI platforms and solutions.

This role is responsible for defining architecture standards, platform capabilities, integration patterns, governance controls, and engineering practices that enable secure, scalable, and reusable GenAI adoption across the enterprise.

The architect will work closely with business stakeholders, engineering teams, platform teams, governance organizations, and cloud providers to establish a centralized GenAIOps capability supporting Retrieval Augmented Generation (RAG), Agentic AI, ModelOps, Evaluation, Observability, and AI Governance.

Enterprise GenAI Architecture

  • Define and govern the enterprise GenAI platform architecture.

  • Establish architecture standards, design patterns, and reusable frameworks for enterprise AI adoption.

  • Lead solution design for RAG, Document Intelligence, Agentic AI, Evaluation, Observability, and Governance capabilities.

  • Define reference architectures and integration patterns for onboarding GenAI use cases.

GenAIOps Platform Leadership

  • Drive the design and implementation of centralized GenAIOps capabilities including:

  • RAG & Retrieval Services

  • AgentOps

  • ModelOps / LLMOps

  • Evaluation Pipelines

  • Observability & Monitoring

  • AI Governance & Controls

  • Establish reusable engineering patterns and shared platform services.

Architecture Governance

  • Lead architecture reviews and technical governance processes.

  • Ensure alignment with enterprise security, compliance, risk, and regulatory requirements.

  • Define standards for Responsible AI, auditability, traceability, and human-in-the-loop controls.

  • Participate in governance forums and stakeholder reviews.

Cloud & Integration Strategy

  • Define cloud architecture and deployment strategies across Azure, AWS, or hybrid environments.

  • Establish enterprise integration patterns for APIs, data platforms, document repositories, workflow systems, and identity providers.

  • Lead architecture decisions around scalability, resiliency, security, and performance.

Engineering Leadership

  • Provide technical leadership to Value Engineers, Context Engineers, Alignment Engineers, and ModelOps teams.

  • Support platform onboarding and use case architecture activities.

  • Mentor engineering teams and drive adoption of best practices.

  • Evaluate emerging GenAI technologies and recommend platform enhancements.

Stakeholder Engagement

  • Collaborate with business and technology leaders to align architecture decisions with strategic objectives.

  • Support roadmap planning, platform evolution, and capability expansion initiatives.

  • Act as the primary architecture authority for enterprise GenAI initiatives., System One, and its subsidiaries including Joulé, ALTA IT Services, CM Access, TPGS, and MOUNTAIN, LTD., are leaders in delivering workforce solutions and integrated services across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible full-time employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

Requirements

  • 10+ years of experience in Solution Architecture, Enterprise Architecture, Cloud Architecture, or Platform Engineering.

  • 3+ years of experience designing and implementing Generative AI and enterprise AI solutions.

  • Deep understanding of:

  • Large Language Models (LLMs)

  • Retrieval Augmented Generation (RAG)

  • Agentic AI

  • Prompt Engineering

  • AI Evaluation Frameworks

  • ModelOps / LLMOps

  • AI Governance

  • Experience designing enterprise-scale cloud solutions on Azure, AWS, or GCP.

  • Strong knowledge of microservices, APIs, event-driven architectures, and distributed systems.

  • Experience leading architecture governance and enterprise technology standards.

  • Strong stakeholder management and executive communication skills.

Success Measures

  • Establish a scalable and reusable enterprise GenAI platform.

  • Accelerate onboarding of GenAI use cases through reusable architecture patterns.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:56 min

Leveraging GitOps for AI auditing and instant rollbacks

Jaroslaw Gajewski Jaroslaw Gajewski · WWC Europe 2026

3:07 min

Transitioning architecture to microservices at Netflix

Steve Upton Steve Upton · WWC 2022

2:37 min

Tracing the evolution from early AI to generative AI

Mike Mike · WWC 2025

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

1:09 min

Managing enterprise execution with the Operate runtime

Marcin Makowski Marcin Makowski · WWC Europe 2026

2:52 min

Scaling generative AI use cases across large enterprises

Mike Butcher Mike Butcher +3 · WWC 2024

Videos

See all

Related articles

See all