Generative AI Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+23 more
Job description
· GenAI Solution Engineering & Advanced RAG
· Orchestration: Design and build production GenAI applications using LangChain and LangGraph for multi-agent, stateful, and graph-based workflows.
· RAG Optimization: Develop and optimize RAG pipelines including advanced patterns like HyDE, re-ranking, hybrid search, multi-hop retrieval, and RAPTOR hierarchical summarization.
· API Development: Build and expose GenAI capabilities as RESTful and streaming APIs using FastAPI (with async support, dependency injection, and OpenAPI documentation).
· MCP Server Development & LLMOps
· Context Architecture: Architect and maintain Model Context Protocol (MCP) servers to securely connect LLMs to heterogeneous enterprise data sources (SQL, NoSQL, APIs).
· Observability: Integrate systems with frameworks like LangSmith, Helicone, Arize, or OpenTelemetry for tracing, latency profiling, and prompt lineage.
· Guardrails & Monitoring: Own prompt versioning, model evaluation (RAGAS, ROUGE, BERTScore), and implement guardrails (Guardrails AI, NeMo Guardrails) for PII redaction and toxicity filtering.
Full-Stack Integration & Governance
Angular Frontend: Develop Angular-based user interfaces (chat UIs, agent monitors, dashboards) and consume FastAPI streaming endpoints (SSE / WebSockets) for real-time token streaming.
Platform Governance: Contribute to architectural decisions around model routing, semantic caching (Redis), and multi-tenant isolation while ensuring compliance with enterprise data governance.
Requirements
Overall Experience: 8+ Years (with strong Python expertise)
GenAI Experience: 2+ Years (in Production Environments, not just POCs), · Experience: 8+ years of total software engineering experience; 2+ years of hands-on, production-level Generative AI experience.
· Core GenAI Stack: LangChain, LangGraph, LLM APIs (OpenAI, Anthropic, Azure, Bedrock), and Vector Stores (Chroma, Pinecone, Weaviate, pgvector).
· Backend & Protocol: Python 3.10+ (async/await, Pydantic v2), FastAPI, and hands-on experience building/deploying MCP servers or equivalent context-injection frameworks.
· Frontend: Angular 15+ (components, services, RxJS, and signals) to successfully bridge backend AI services with the user interface.
· Data & Infrastructure: SQL + NoSQL (PostgreSQL, MongoDB, Redis), Docker, Kubernetes, and GitHub Actions CI/CD.
· Preferred (Plus) Skills
· Experience with graph-based architectures for complex, cyclic reasoning tasks.
· Familiarity with fine-tuning workflows (LoRA/QLoRA, PEFT, DPO/RLHF) and distributed inference (vLLM, TGI, Triton).
· Prior experience in regulated industries (Banking, FinTech, Healthcare) with awareness of model risk management frameworks (e.g., SR 11-7).
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?
Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud
WWC24 Talk - Scott Hanselman - AI: Superhero or Supervillain?
How to Use Generative AI to Accelerate Learning to Code