Gen AI Architect

GENAI LLC
Cleveland, OH, United States
3 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) A/B Testing Artificial Intelligence Cloud Computing Continuous Integration Information Leak Prevention Graph Database Python (Programming Language) Machine Learning Metadata Open Source Technology Software Architecture
+31 more
Inference Optimization Search Technologies Software Engineering Unstructured Data Workflow Management Systems AI Infrastructure Data Logging Google Cloud Feature Engineering Retrieval-Augmented Generation Delivery Pipeline Large Language Models Multi-Agent Systems Prompt Engineering IT Architecture Generative AI Indexer Knowledge Engineering Containerization Kubernetes Data Management Machine Learning Operations Claude Drift Detection Api Design Prompt Orchestration GPT Software Version Control Data Pipelines Unsupervised Learning Microservices

Job description

The GenAI Architect is responsible for designing, guiding, and implementing enterprise-grade Generative AI solutions embedded within product platforms. This role bridges AI research, engineering, and product development, ensuring GenAI capabilities are scalable, secure, and aligned with business objectives., * Design and own the end-to-end architecture for GenAI-powered product features.

  • Guide engineering teams on best practices for GenAI development and integration.
  • Establish standards and patterns for prompts, agents, and inference layers.
  • Ensure security, compliance, and responsible AI principles are built into every solution.

Requirements

  • 8+ years of experience in software architecture, ML engineering, or platform engineering.
  • 2+ years of hands-on experience with AI/ML systems, including Generative AI.
  • Strong software engineering background (Python, Java, or similar).
  • Prior work with enterprise AI governance or regulated industries.
  • Familiarity with open-source AI ecosystems.
  • Background in data platforms or analytics engineering.

Core Generative AI & ML Expertise

  • Strong understanding of Generative AI models (LLMs, multimodal models, embeddings).
  • Hands-on experience with foundation models (e.g., GPT-style, Claude-style, LLaMA-style) and model adaptation techniques.
  • Expertise in prompt engineering, prompt orchestration, and agent-based frameworks.
  • Solid grounding in machine learning fundamentals, including supervised/unsupervised learning, evaluation metrics, and inference optimization.

AI Architecture & System Design

  • Ability to design scalable, modular GenAI architectures for production use.

Experience with:

  • RAG (Retrieval-Augmented Generation) architectures
  • Vector databases (semantic search, embeddings indexing)
  • Multi-agent systems and workflow orchestration
  • Strong understanding of low-latency inference, model routing, and fallback strategies.
  • Knowledge of event-driven, microservices, and API-first architectures.

Product Engineering & Integration

  • Experience integrating GenAI capabilities into customer-facing and internal products.
  • Ability to translate product requirements into AI-driven capabilities and technical designs.
  • Familiarity with A/B testing, feature flags, and iterative product releases involving AI.

Data & Knowledge Engineering

  • Proficiency in data pipelines, feature engineering, and unstructured data processing.
  • Experience with:
  • Knowledge graphs
  • Metadata-driven architectures
  • Document ingestion and chunking strategies
  • Strong understanding of data quality, provenance, and governance for AI systems.

Cloud, MLOps & Platform Skills

  • Strong experience in cloud-native environments (Google Cloud Platform).
  • Familiarity with MLOps practices, including:
  • Model versioning
  • Deployment pipelines
  • Monitoring, logging, and drift detection
  • Experience with containerization, Kubernetes, and CI/CD pipelines.
  • Knowledge of inference optimization and cost-control strategies.

Security, Privacy & Responsible AI

  • Understanding of AI security risks (prompt injection, data leakage, model abuse).
  • Experience implementing guardrails, content filters, and policy enforcement.
  • Knowledge of responsible AI practices, including explainability, bias mitigation, and compliance.
  • Familiarity with data privacy regulations (e.g., GDPR, enterprise governance standards).

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…