AI LLM Engineer

TalentOla View all jobs
Alpharetta, GA, United States
18 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Performance Tuning Software Deployment Software Engineering Enterprise Software Applications Chatbots Large Language Models Prompt Engineering IT Architecture Low Latency

Job description

We are seeking a Senior AI LLM Engineer to design, deploy, and optimize production-grade conversational AI systems. You will build scalable tool-calling frameworks, integrate AI models with enterprise applications, and implement strict hallucination mitigation controls. A key focus of this role is developing traceable response systems and reusable explanation templates for complex financial calculations. Key Responsibilities AI Architecture & Production Deployment Deploy Solutions: Build and maintain scalable, production-grade LLM applications. Integrate Systems: Connect AI models with enterprise applications and secure APIs. Build Frameworks: Develop robust tool-calling frameworks to orchestrate model-API interactions. Prompt Engineering & Conversation Design Design Strategies: Create advanced prompt strategies and conversation management frameworks. Tune Responses: Optimize conversational context to ensure highly accurate user experiences. Mitigate Risks: Implement automated controls to detect and eliminate model hallucinations. Financial Logic & Traceability Ensure Traceability: Build mechanisms that provide auditable, step-by-step reasoning for generated outputs. Develop Templates: Create reusable explanation templates for pricing methods, revenue sharing models, and expense calculations. Optimize Performance: Conduct continuous prompt tuning and model optimization for cost, latency, and accuracy.

Requirements

Software Engineering: 5+ years of professional software development experience. LLM Expertise: 3+ years of hands-on experience working directly with Large Language Models. Prompt & Conversation Design: 3+ years of experience designing prompt strategies and managing conversation frameworks. Response Tuning: 3+ years of experience implementing, tuning, and auditing conversational AI outputs. o Providing traceable response generation. o Developing reusable explanation templates for pricing methods, revenue sharing models, and expense calculations. o Conducting prompt tuning and model optimization. o Implement hallucination mitigation controls. Technical Skills Proven track record of deploying production-ready AI solutions at scale. Deep understanding of API integration, tool-calling (function calling), and agentic workflows. Experience embedding regulatory compliance, financial traceability, or audit trails into AI responses.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

5:30 min

Building components of a real-world LLM lifecycle

Maxim Salnikov Maxim Salnikov · LIVE

1:00 min

Introduction to chatbot infrastructure and cloud challenges

Stan Girard Stan Girard · World Congress 2024

5:48 min

Balancing delivery latency with stream reliability and scale

Phil Cluff · LIVE

1:28 min

Documenting microservice architectures with the architecture canvas

Benjamin Wolf Benjamin Wolf +1 · World Congress 2025

1:59 min

Building culturally aware LLMs for global audiences

Werner Vogels Werner Vogels +1 · World Congress 2026 Europe

4:30 min

Demonstrating a knowledge graph powered chatbot interface

Tomaz Bratanic · World Congress 2023

Videos

See all

Related articles

See all