LLM Application Engineer

SGA Inc.
San Francisco, CA, United States
4 days ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$120,000.0 - $205,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Computing Platforms Automated Storage and Retrieval Systems Databases Distributed Systems Memory Management Python (Programming Language) Open Source Technology OpenAI Tensorflow Search Technologies
+10 more
Software Engineering Pytorch Large Language Models Multi-Agent Systems Prompt Engineering Generative AI Backend Agentic-AI Production Code Machine Learning Operations

Job description

  • Design, develop, and deploy applications powered by large language models and intelligent workflow automation.
  • Create agent-based systems that support reasoning, planning, memory management, tool integration, and multi-step task execution.
  • Build orchestration frameworks that transform AI-generated outputs into dependable, observable, and secure business processes.
  • Integrate AI solutions with APIs, databases, search platforms, internal services, and third-party systems.
  • Implement prompt engineering, context management, structured responses, and tool-calling techniques to improve model performance.
  • Develop evaluation methodologies, benchmarks, and datasets to monitor quality, accuracy, and regression risks.
  • Troubleshoot issues across the AI stack, including model behavior, orchestration layers, backend systems, and user experience components.
  • Optimize solutions for performance, scalability, response times, and operational cost.
  • Partner with product and engineering stakeholders to convert business requirements into practical AI-driven solutions.
  • Establish best practices for monitoring, experimentation, traceability, and continuous improvement of production AI systems.

Requirements

  • Strong software engineering background with experience building production-grade AI applications.
  • Hands-on experience with large language models, generative AI technologies, or autonomous agent architectures.
  • Proficiency in Python development.
  • Experience designing prompts, workflows, evaluation frameworks, and AI behavior optimization strategies.
  • Knowledge of LLM platforms, model APIs, and open-source model ecosystems.
  • Ability to develop clean, maintainable, and scalable production code.
  • Experience working across multiple layers of AI solutions, including models, systems, and end-user applications.
  • Strong analytical and problem-solving capabilities in fast-paced and evolving environments.

Preferred Skills:

  • Experience with AI orchestration frameworks and agent development platforms.
  • Knowledge of vector databases, retrieval systems, and semantic search technologies.
  • Experience building backend services, APIs, and distributed systems.
  • Familiarity with machine learning frameworks such as PyTorch or JAX.
  • Demonstrated success in iterative product development and continuous improvement initiatives.

Tech Stack

  • Python
  • LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models
  • Agent frameworks and orchestration systems
  • Vector databases and retrieval systems
  • Backend services, APIs, and distributed systems
  • PyTorch / JAX

About the company

By applying for a job with SGA, you agree to allow SGA to process your application for this and future opportunities in accordance with our Privacy Policy. Also, to ensure timely processing, you agree to be contacted by our AI recruiter via email, text, or phone. Message frequency varies and data rates may apply, but you can reply STOP to any SMS message to opt-out of texts and may contact SGA at info@sgainc.com to opt-out of AI communications. The choice not to engage with AI will not adversely impact your consideration for placement. AI is not used to make any hiring determinations.

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let’s work better together, we mean it. You’ll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…