Gen AI Engineer

AIT Global, Inc.
Evanston, IL, United States
15 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Program Optimization DevOps Python (Programming Language) Language Modeling Large Language Models Multi-Agent Systems Build Tools GPT

Job description

  • Design and implement stateful multi-agent workflows using LangGraph (checkpointers, retries, subgraphs, tool calling).
  • Define Agent-to-Agent (A2A) interaction patterns for decomposition, verification, and self-correction.
  • Build tool-using agents with structured outputs, schema enforcement, and deterministic execution paths.
  • Handle agent failure modes such as hallucinations, tool misuse, and partial execution.
  • Select and tune vector stores (FAISS, Milvus, Pinecone, Weaviate). Inference & Model Optimization
  • Operate and optimize LLM inference pipelines with focus on latency, throughput, and cost.
  • Work with vLLM (continuous batching, memory efficiency).
  • Make informed trade-offs between model size, context length, and output quality.
  • Apply quantization and other inference-time optimizations where required. Evaluation & Iteration
  • Design and run LLM evaluation workflows using tools such as LangSmith, Ragas, TruLens, or equivalent.
  • Define acceptance metrics for Grounded Ness, Context relevance, Answer quality.
  • Use evaluation results to iterate on prompts, retrieval strategies, and agent design.
  • Ability to reason about: Attention mechanisms and scaling, Decoder-only vs encoder decoder architectures o Prompting vs retrieval vs fine-tuning trade-offs.

Requirements

Agentic Workflows (Strong), Communication & collaboration (Strong), Lang chain, Python (Strong), LLM Foundations. Good to have skills:

  • DevOps - GenAI, Transformer-based models and seq-to-seq paradigms.
  • Pharma industry/domain experience is preferred., * Hands-on experience solving non-trivial GenAI use cases. Agentic & RAG Expertise
  • Proven experience building agentic workflows with LangGraph.
  • Strong understanding of tool calling, structured outputs, and schema contracts.
  • Deep experience with RAG systems, including retrieval evaluation and optimization.
  • Experience with vector databases and embedding strategies. Inference & Evaluation
  • Experience running and tuning LLM inference workloads.
  • Familiarity with vLLM or similar inference engines.
  • Experience with LLM evaluation frameworks and metric-driven iteration.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · World Congress 2024

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

48 sec

Exploring alternative build tools and experimental web components

Sasha Shynkevich · LIVE

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · World Congress 2025

4:04 min

Defining agentic AI and the tool execution architecture

Rijk van Zanten Rijk van Zanten · Europe 2026 Virtual

Videos

See all

Related articles

See all