> Markdown version of [/jobs/ext/1953427-sr-software-engineer-ii-ai](https://www.wearedevelopers.com/jobs/ext/1953427-sr-software-engineer-ii-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Software Engineer II - AI - **Company:** iHerb - **Location:** Pasadena, CA, United States (Remote available) - **Experience:** Expert - **Salary:** $187,000.0 - $235,000.0 - **Contract:** Permanent contract - **Skills:** Microsoft Word, Microsoft Excel, Artificial Intelligence, Automated Storage and Retrieval Systems, Automation of Tests, Software Quality, Code Review, Continuous Integration, Cursor (Graphical User Interface Elements), Programming Tools, Monitoring of Systems, Python (Programming Language), Location Search Optimization, Automation of Marketing, Microsoft Office, Microsoft PowerPoint, Systems Development Life Cycle, Search Technologies, Software Engineering, Systems Integration, GitHub Copilot, Large Language Models, Prompt Engineering, AI Platforms, Solid Principles, Information Technology, Low Latency, Machine Learning Operations - **Published:** August 6, 2026 - **Apply:** https://arc.dev/remote-jobs/j/redirect/paene2523l ## About the Role * AI-driven SDLC : hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor. The bar is not awareness; it is daily use in delivering real software. * Full-stack awareness: comfortable contributing across layers of the stack when needed; purely single-layer specialists are not the target profile. * Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoff. * Code quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CD. * Fully autonomous; drives technical decisions within the team; mentors junior engineers. * Python proficiency; comfortable building and operating production LLM applications. * Hands-on experience with at least one specialization: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM-based workflow automation. * Understanding of prompt engineering, context window management, and LLM output quality tradeoffs. * Familiarity with vector databases, embedding models, or semantic search. * High degree of accuracy and attention to detail * Excellent organization skills and ability to multi-task Preferred * Exposure to MLOps tooling or model deployment pipelines. * Contributions to internal developer tooling, golden path standards, or SDLC process improvements. * Experience with e-commerce platforms, product catalogs, or high-traffic consumer applications. * Exposure to MLOps tooling or model deployment pipelines. * Experience working in globally distributed teams. * Track record of documenting architectural decisions, writing RFCs, or contributing to engineering wikis. Equipment Knowledge * Experience with Microsoft Office Suite (Word, Excel, PowerPoint) * Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred Experience Requirements Generally requires a minimum of 10+ years of software engineering experience. Education Requirements Bachelor's Degree in Computer Science or related field preferred, or a combination of education and equivalent work experience. Judgment/Reasoning Ability: Able to identify, troubleshoot and resolve problems quickly using sound judgment, poise and diplomacy. Ability to use judgment and reasoning skills, and determine when to escalate issues, as required, in a timely manner. ## Description The Sr. Software Engineer II - AI will lead the build of GenAI-powered product experiences and the shared AI platform infrastructure that powers them. This includes RAG pipelines over the iHerb catalog and customer reviews, LLM-driven personalization, a conversational Wellness Agent, agentic workflow systems, and the evals and MLOps layer that makes AI features production-grade and repeatable. Specializations within this track include: RAG and personalization, agent framework and tool use, evals and guardrails, and LLM application development for internal business functions such as marketing automation and BI agents. Job Expectations * Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation. * Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability. * Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces. * Evaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using data. * Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code. * Coordinate with the Personalization team to align GenAI product features with existing ML personalization signals. * Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base. * Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents. The duties and responsibilities described above may provide only a partial description of this position. This is not an exhaustive list of all aspects of the job. Other duties and responsibilities not outlined in this document may be added as necessary or desirable, with or without notice. ## Related Videos - [Swapping Low Latency Data Storage Under High Load](https://www.wearedevelopers.com/videos/746-swapping-low-latency-data-storage-under-high-load) - [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data) - [This App Reached 10,000 Users in One Week. Here's How.](https://www.wearedevelopers.com/videos/100329-this-app-reached-10-000-users-in-one-week-here-s-how) - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [Unleash the power of 5G in your code: transform your apps](https://www.wearedevelopers.com/videos/1567-unleash-the-power-of-5g-in-your-code-transform-your-apps) - [Engineering Mindset in the Age of AI - Gunnar Grosch, AWS](https://www.wearedevelopers.com/videos/1735-engineering-mindset-in-the-age-of-ai-gunnar-grosch-aws) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)