MLOps Technical Lead

TechDigital Corporation
Austin, TX, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

LangGraph Framework Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Software Debugging Distributed Systems Fault Tolerance Python (Programming Language) Software Deployment Data Streaming
+19 more
System Testing Systems Integration TypeScript Large Language Models Multi-Agent Systems Generative AI Backend Agentic-AI Rate Limiting Containerization Kubernetes CrewAI Data Analytics Data Management Machine Learning Operations Evaluation of Large Language Models Invoking Functions Model Context Protocol Docker

Job description

Build intelligent, data-driven platform. The focus is to support the development of next-generation test analytics and test agents that enable faster insights, improved diagnostics, and scalable infrastructure for Generative AI systems connecting test stations, line level data and pipelines . You will build automated evaluation tools, and conduct rigorous statistical analyses to ensure the reliability of both human and AI-based assessment systems., 2. β€œHave you built MCP servers/integrations or custom tool-use systems for LLMs?”

  1. β€œHow do you evaluate whether an LLM-based feature is working well? What makes this hard?”
  2. β€œWalk me through how you’d deploy and scale an AI service on Kubernetes.”

Requirements

Technical Leadership, Statistics, Data Management, Artificial Intelligence (AI), Testing, System Test, Diagnostics Solutions/Software, Benchmarking, Analysis Skills, Distributed Computing, Backend/Systems Experience 3+ years building production backend or distributed systems (pre-AI experience required) Production AI Systems Has shipped AI/LLM features serving real users at scale - not just prototypes or demos Agentic Systems Has built AI agents, skills, tools, or MCP (Model Context Protocol) integrations Python Proficient for backend development Secondary Language Working knowledge of Go, TypeScript, or Rust Cloud Infrastructure Deep experience with AWS/GCP/Azure - cost optimization, compute decisions, not just deployment Container & Orchestration Hands-on with Docker and Kubernetes - can build, deploy, debug, and scale services themselves LLM Integration Understands token economics, context limits, rate limiting, structured outputs, API failure modes LLM Evaluation Understands how to evaluate LLM outputs and the inherent challenges (non-determinism, quality measurement, regression detection) Hands-On Engineer Not just an architect - writes code, debugs production issues, deploys their own work

Preferred / Differentiators

  • Built multi-step agentic workflows with tool use and function calling
  • Experience with agent orchestration frameworks (LangGraph, CrewAI, or custom)
  • Built guardrails, fallbacks, or graceful degradation for AI systems
  • Streaming inference and async agent orchestration, * AI experience is mainly academic, research, or tutorial-based
  • No production systems experience (only notebooks/demos)
  • Looking for entry-level role with heavy mentorship
  • Background is primarily data science/analytics rather than engineering
  • β€œArchitects” who don’t write or deploy code themselves

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…