AI Platform Engineer
SWIFT
Dallas, TX, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours
Job source
Tech stack
LangGraph Framework
Java (Programming Language)
Artificial Intelligence
Cloud Computing
Continuous Integration
Elasticsearch
Python (Programming Language)
Performance Tuning
OpenAI
Site Reliability Engineering Practices
Search Technologies
Pinecone
+32 more
Model Garden (Google Cloud)
QLoRA
LangChain
Large Language Models
Multi-Agent Systems
Hallucination Detection
Qwen
NeMo Guardrails
Llamaindex
Generative AI
Langfuse β LLM Observability and Analytics Platform
Agentic-AI
Rate Limiting
Usage Tracking
Pgvector
AI Platforms
LangSmith
Kubernetes
Low Latency
CrewAI
RAGAS (Retrieval Augmented Generation Assessment)
Weaviate
AutoGen
Arize Phoenix
Ollama
LiteLLM
Machine Learning Operations
DeepEval
Model Context Protocol
Terraform
Promptfoo
Programming Languages
Job description
Build and operate a production-grade Agentic AI platform, including orchestration, model gateway, agent registry, retrieval, guardrails, evaluation, and observability. Responsible for platform reliability, security, performance, and cost optimization. Core Technical Skills
- LLM & Agent Orchestration: LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or Google Agent Development Kit (ADK); production multi-agent orchestration, state management, and retry/fallback design.
- Model Serving & Gateway: LiteLLM, Portkey, Kong AI Gateway, TrueFoundry, or Vertex AI Model Garden; routing, fallback, rate limiting, and token/usage tracking. Open-weight model serving (Llama, Mistral, Gemma, Qwen) using vLLM, TGI, Ollama, or Vertex endpoints; fine-tuning and adapter techniques (LoRA/QLoRA).
- Retrieval-Augmented Generation (RAG): Vector stores (Vertex Vector Search, Pinecone, Weaviate, pgvector, Elasticsearch), embedding models, chunking, hybrid and semantic search, reranking, and grounding-quality evaluation.
- Agent Infrastructure: Model Context Protocol (MCP), tool/function-calling contracts, agent registries, permission enforcement, and separation of reasoning from acting agents.
- Evaluation & LLMOps: RAGAS, DeepEval, Promptfoo, or OpenAI Evals; offline and online evaluation, regression suites, drift and hallucination detection; MLflow, LangSmith, Langfuse, Arize Phoenix, or Braintrust.
- Guardrails & AI Security: NeMo Guardrails, Guardrails AI, Model Armor, or Lakera; prompt-injection, jailbreak, and data-leakage defense; PII detection and redaction.
- Observability: OpenTelemetry-based tracing for LLM and agent calls, token, latency, and cost telemetry, and quality-signal monitoring.
- Cloud & Runtime: Kubernetes, containers, GCP (GKE, Vertex AI, Cloud Run), Terraform, CI/CD, and SRE practices for production AI services.
- Programming Languages: Strong Python; Go or Java is useful for platform services.
Requirements
Typically 6+ years of software or platform engineering experience, with hands-on production ownership of AI or ML infrastructure. Must have personally built and operated agentic AI or LLM systems in production, not just prototypes.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦