LLM Application Engineers

As an LLM Application Engineer, you will build the intelligence layer that powers the AI experiences. You will work at the intersection of Large Language Models (LLMs), software engineering, and product designing agent workflows, improving model behavior, and turning Artificial Intelligence (AI) capabilities into reliable user experiences. You will own problems end-to-end, from understanding user needs, designing Agentic workflows, integrating models and tools, building evaluation systems and continuously improving AI behavior in production. This position is 100% Remote., Design systems for reasoning, planning, memory, tool use and multi-step execution.

• Build reliable orchestration pipelines that turn probabilistic model outputs into predictable, observable, and safe actions.

• Integrate Large Language Models (LLMs) with APIs, databases, search, internal services, and external tools.

• Develop prompting, context engineering, structured outputs, tool-calling, and other techniques to improve model behavior.

• Build evaluation frameworks and datasets to measure AI quality, reliability, and regressions.

• Debug AI systems across the entire stack from model behavior and prompts to orchestration, backend services, and product UX.

• Optimize AI systems for quality, latency, and cost.

• Work closely with product and engineering teams to turn ambiguous product problems into working AI solutions.

• Establish production practices for observability, tracing, experimentation, evaluation, and continuous improvement.

LLM Application Engineer Outcomes:

• Artificial Intelligence (AI) features reach production quickly and deliver measurable user impact.

• LLM-powered workflows are reliable, scalable, observable, and maintainable.

• Artificial Intelligence (AI) quality improves through systematic evaluation, experimentation, and iteration.

• Artificial Intelligence (AI) workflows become increasingly predictable, efficient, and cost-effective., Looking to hire an LLM Application Engineer in San Francisco, CA or in other cities? Our IT recruiting agencies and staffing companies can help.

Artificial Intelligence (AI) experience required.

• Strong software engineering fundamentals with experience building AI-powered applications.

• Hands-on experience with Large Language Models (LLMs), generative AI, or agent-based systems.

• Experience designing prompts, workflows, evaluations, or AI behavior.

• Ability to write clean, production-quality code.

• Comfortable working across abstraction layers from model to system to product.

• Strong problem-solving skills in ambiguous, fast-moving environments.

• Bias toward shipping, iteration, and continuous improvement.

• Tech Stack: Python, LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models, Agent frameworks and orchestration systems, Vector databases and retrieval systems, Backend services, APIs, and distributed systems, and PyTorch / JAX.

Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.

Keywords: San Francisco CA Jobs, Agent Frameworks, AI, Artificial Intelligence, AI Agent Workflows, APIs, Application Engineer, Backend, Databases, Distributed Systems, JAX, LLM, Large Language Model, LLM APIs, OpenAI-Compatible APIs, Orchestration Systems, Python, PyTorch, UX, User Experience, Vector Databases, Work From Home, Remote, California Recruiters, IT Jobs, California Recruiting