GenAI Ops Solution Architect

System One
Pittsburgh, PA, United States
15 days ago
Apply on www.techcareers.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Application Frameworks Computing Platforms Microsoft Azure Cloud Engineering Software Design Patterns Distributed Systems Monitoring of Systems Cloud Services Enterprise Application Integration
+10 more
Large Language Models Prompt Engineering Generative AI Event Driven Architecture Deployment Automation Data Management Machine Learning Operations Virtual Agents Cloud Integration Microservices

Job description

GenAI Ops Solution Architect who will lead the design, governance, and evolution of enterprise-scale Generative AI platforms and solutions.

This role is responsible for defining architecture standards, platform capabilities, integration patterns, governance controls, and engineering practices that enable secure, scalable, and reusable GenAI adoption across the enterprise.

The architect will work closely with business stakeholders, engineering teams, platform teams, governance organizations, and cloud providers to establish a centralized GenAIOps capability supporting Retrieval Augmented Generation (RAG), Agentic AI, ModelOps, Evaluation, Observability, and AI Governance.

Enterprise GenAI Architecture

  • Define and govern the enterprise GenAI platform architecture.
  • Establish architecture standards, design patterns, and reusable frameworks for enterprise AI adoption.
  • Lead solution design for RAG, Document Intelligence, Agentic AI, Evaluation, Observability, and Governance capabilities.
  • Define reference architectures and integration patterns for onboarding GenAI use cases.

GenAIOps Platform Leadership

  • Drive the design and implementation of centralized GenAIOps capabilities including:
  • RAG & Retrieval Services
  • AgentOps
  • ModelOps / LLMOps
  • Evaluation Pipelines
  • Observability & Monitoring
  • AI Governance & Controls
  • Establish reusable engineering patterns and shared platform services.

Architecture Governance

  • Lead architecture reviews and technical governance processes.
  • Ensure alignment with enterprise security, compliance, risk, and regulatory requirements.
  • Define standards for Responsible AI, auditability, traceability, and human-in-the-loop controls.
  • Participate in governance forums and stakeholder reviews.

Cloud & Integration Strategy

  • Define cloud architecture and deployment strategies across Azure, AWS, or hybrid environments.
  • Establish enterprise integration patterns for APIs, data platforms, document repositories, workflow systems, and identity providers.
  • Lead architecture decisions around scalability, resiliency, security, and performance.

Engineering Leadership

  • Provide technical leadership to Value Engineers, Context Engineers, Alignment Engineers, and ModelOps teams.
  • Support platform onboarding and use case architecture activities.
  • Mentor engineering teams and drive adoption of best practices.
  • Evaluate emerging GenAI technologies and recommend platform enhancements.

Stakeholder Engagement

  • Collaborate with business and technology leaders to align architecture decisions with strategic objectives.
  • Support roadmap planning, platform evolution, and capability expansion initiatives.
  • Act as the primary architecture authority for enterprise GenAI initiatives., * Establish a scalable and reusable enterprise GenAI platform.
  • Accelerate onboarding of GenAI use cases through reusable architecture patterns.
  • Ensure alignment with governance, security, and compliance requirements.
  • Improve platform adoption, operational efficiency, and engineering productivity.
  • Enable sustainable long-term ownership through architecture standardization and knowledge transfer.

Requirements

  • 10+ years of experience in Solution Architecture, Enterprise Architecture, Cloud Architecture, or Platform Engineering.
  • 3+ years of experience designing and implementing Generative AI and enterprise AI solutions.
  • Deep understanding of:
  • Large Language Models (LLMs)
  • Retrieval Augmented Generation (RAG)
  • Agentic AI
  • Prompt Engineering
  • AI Evaluation Frameworks
  • ModelOps / LLMOps
  • AI Governance
  • Experience designing enterprise-scale cloud solutions on Azure, AWS, or GCP.
  • Strong knowledge of microservices, APIs, event-driven architectures, and distributed systems.
  • Experience leading architecture governance and enterprise technology standards.
  • Strong stakeholder management and executive communication skills.

Benefits & conditions

System One, and its subsidiaries including Joulé, ALTA IT Services, CM Access, TPGS, and MOUNTAIN, LTD., are leaders in delivering workforce solutions and integrated services across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible full-time employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.techcareers.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

3:07 min

Transitioning architecture to microservices at Netflix

Steve Upton Steve Upton · World Congress 2022

2:37 min

Tracing the evolution from early AI to generative AI

Mike Mike · World Congress 2025

3:21 min

Navigating the ethical integration of virtual colleagues

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

52 sec

Transitioning from software consulting to AI building

Malte Lensch Malte Lensch · World Congress 2026 Europe

3:38 min

Shifting from monolithic architectures to microservices and containers

Markus Kett Markus Kett · World Congress 2022

Videos

See all

Related articles

See all