Sr. Software Engineer - AI Agent and LLM Applications

We are building an AI Agent-powered platform to handle customer issues related to AI Servers and Racks. The system will interact with customers via chatbot, analyze issue tickets, and generate troubleshooting steps for the on-site service team. This role focuses on the design, implementation, and system integration of the Agent platform., * Design and implement Multi-Agent or Tool-using Agent systems (using OpenClaw or other agent frameworks)

• Define, develop, and maintain Tools / Function Calling interfaces that agents can invoke
• Integrate with external systems (ticket systems, databases, monitoring data, automation workflows, etc.)
• Build and optimize the RAG pipeline and integrate the existing Knowledge Base
• Support hybrid deployment and switching between cloud models (e.g., Grok) and local models (e.g., Ollama)
• Implement agent execution flows, error handling, human-in-the-loop, and escalation mechanisms
• Collaborate with the Automation team to ensure stable Tool interfaces and proper access control
• Establish basic logging, tracing, and observability

• Experience in LLM applications or AI Agent development (2+ years of experience is preferred)
• Hands-on experience building Tool-using Agents or Multi-Agent systems
• Familiarity with Function Calling / Tool Use and agent orchestration
• Experience implementing RAG (vector databases, embeddings, retrieval tuning)
• Strong Python skills with API design and system integration experience
• Experience with at least one major LLM API and local model deployment solutions
• Ability to communicate effectively with cross-functional teams (Automation, Domain SMEs)
• Experience integrating with ITSM, technical support, operations, or monitoring systems is a plus
• Hands-on experience with frameworks such as OpenClaw, LangGraph, CrewAI, or AutoGen is a plus
• Experience with agent observability, cost control, or production deployment is a plus
• Experience implementing human-in-the-loop or escalation mechanisms is a plus *

$160,000 - $ 200,000

The salary offered will depend on several factors, including your location, level, education, training, specific skills, years of experience, and comparison to other employees already in this role. In addition to a comprehensive benefits package, candidates may be eligible for other forms of compensation, such as participation in bonus and equity award programs.

Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.