AI Platform Engineer 100% REmote
Apetan Consulting
United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours
Job source
Tech stack
LangGraph Framework
Java (Programming Language)
Artificial Intelligence
Cloud Computing
Continuous Integration
Elasticsearch
Python (Programming Language)
Performance Tuning
OpenAI
Search Technologies
Pinecone
Model Garden (Google Cloud)
+27 more
QLoRA
Google Cloud
LangChain
Retrieval-Augmented Generation
Large Language Models
Hallucination Detection
Qwen
NeMo Guardrails
Llamaindex
Langfuse β LLM Observability and Analytics Platform
Rate Limiting
Pgvector
AI Platforms
LangSmith
Kubernetes
CrewAI
RAGAS (Retrieval Augmented Generation Assessment)
Weaviate
AutoGen
Arize Phoenix
Ollama
LiteLLM
Machine Learning Operations
DeepEval
Model Context Protocol
Terraform
Promptfoo
Job description
- LLM and agent orchestration: LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or the Google Agent Development Kit (ADK), with production multi-agent orchestration, state management and retry/fallback design.
- Model serving and gateway: LiteLLM, Portkey, Kong AI Gateway, TrueFoundry, or Vertex AI Model Garden; routing, fallback, rate limiting and token/usage capture. Serving open-weight models (Llama, Mistral, Gemma, Qwen) via vLLM, TGI, Ollama or Vertex endpoints; fine-tuning and adapter techniques (LoRA/QLoRA).
- Retrieval-augmented generation: vector stores (Vertex Vector Search, Pinecone, Weaviate, pgvector, Elasticsearch), embedding models, chunking, hybrid and semantic search, reranking, and grounding-quality evaluation.
- Agent infrastructure: Model Context Protocol (MCP) and tool/function-calling contracts, agent registries, permission enforcement, and the separation of reasoning from acting agents.
- Evaluation and LLMOps: eval harness design with RAGAS, DeepEval, Promptfoo, or OpenAI Evals; offline and online evaluation, regression suites, drift and hallucination detection; experiment tracking with MLflow, LangSmith, Langfuse, Arize Phoenix or Braintrust.
- Guardrails and AI security: NeMo Guardrails, Guardrails AI, Model Armor, Lakera; prompt-injection, jailbreak and data-leakage defense; PII detection and redaction in prompt and response.
- Observability: OpenTelemetry-based tracing for LLM and agent calls, token and latency and cost telemetry, quality-signal monitoring feeding alerting.
- Cloud and runtime: Kubernetes and containers, Google Cloud Platform preferred (GKE, Vertex AI, Cloud Run), infrastructure-as-code (Terraform), CI/CD, and SRE practice for production AI services.
- Languages: strong Python; Go or Java useful for platform services.
Requirements
Typically 6+ years in software or platform engineering, with hands-on production ownership of AI or ML infrastructure. Has personally built and operated agentic or LLM systems in production, not only prototyped them.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦