> Markdown version of [/jobs/ext/3378179-software-engineer-ai-agent-llm](https://www.wearedevelopers.com/jobs/ext/3378179-software-engineer-ai-agent-llm). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, AI Agent & LLM

- **Company:** OTTER, INC.
- **Location:** Seattle, United States (Remote available)
- **Experience:** Expert
- **Salary:** $185,000.0 - $230,000.0
- **Contract:** Permanent contract
- **Skills:** C++ (Programming Language), Encodings, Relational Databases, Python (Programming Language), Performance Tuning, Search Technologies, Enterprise Search, Large Language Models, Deep Learning, Generative AI, Question Answering, Information Technology, Full-text Search
- **Published:** September 4, 2026
- **Apply:** https://startup.jobs/senior-software-engineer-ai-agent-llm-otterai-8788734

## About the Role

* Holds a Masters degree in Computer Science, or a relevant field, PhD a plus.
 * 5+ years of experience in search, recommendation or question answering systems.
 * In-depth knowledge of relevance measurement, tuning, and modeling.
 * Engineering experience with large language models and RAG systems.
 * Expertise in Python and/or C++.
 * Exceptional problem-solving capabilities coupled with meticulous attention to detail.
 * Outstanding communication skills to explain complex concepts convincingly to non-technical team members.
 * Abilities to contribute individually while functioning effectively as part of a team.
 * Familiarity with embedding-based search systems will be considered a major advantage.

## Description

We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will hold a deep comprehension of search and recommendations algorithms and infrastructure, including retrieval augmented generation (RAG), semantic search using embeddings, text indexing and retrieval, query understanding, various ranking algorithms etc.. In your crucial role, you'll be responsible for managing every aspect of our sophisticated enterprise search system, spearheading the design, development, and optimization of search system accuracy and performance.

Your Impact

 * Design, develop, and oversee our enterprise search infrastructure, employing a mix of vector databases, full-text search engine, and relational database techniques.
 * Understand the user's information needs by developing deep learning-based NLP algorithms to analyze, reformulate and suggest search queries effectively.
 * Design, implement, and deploy various ranking algorithms to deliver the most relevant results with the best user experience.
 * Evaluate and optimize algorithm accuracy by focusing on key metrics..
 * Constantly track and analyze end-to-end system performance, leading improvement initiatives as required.
 * Stay informed about the latest industry developments and emerging technologies, aligning our search system with, or advancing it beyond, the industry benchmarks.


## Related Videos

- [A Brief History of Data Storage](https://www.wearedevelopers.com/videos/974-a-brief-history-of-data-storage)
- [The pitfalls of Deep Learning - When Neural Networks are not the solution](https://www.wearedevelopers.com/videos/14-the-pitfalls-of-deep-learning-when-neural-networks-are-not-the-solution)
- [Your imaginations is (no longer) the limit: how Generative AI empowers people to be creative](https://www.wearedevelopers.com/videos/741-your-imaginations-is-no-longer-the-limit-how-generative-ai-empowers-people-to-be-creative)
- [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care)
- [JSON and Beyond](https://www.wearedevelopers.com/videos/968-json-and-beyond)
- [AI Search Insights from OtterlyAI: What We Tested, What Failed, and What Actually Works](https://www.wearedevelopers.com/videos/100133-ai-search-insights-from-otterlyai-what-we-tested-what-failed-and-what-actually-works)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 118 - not a total recall](https://www.wearedevelopers.com/magazine/452-dev-digest-118-not-a-total-recall)
- [ I Gave a Video Editor More Autonomy Than a Trading Bot. On Purpose.](https://www.wearedevelopers.com/magazine/773-i-gave-a-video-editor-more-autonomy-than-a-trading-bot-on-purpose)