Gen-AI Senior Software Engineer, Full Stack

iHerb
Shanghai, WV, United States
4 days ago
Apply on arc.dev
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

LangGraph Framework Java (Programming Language) Artificial Intelligence Automation of Tests Code Generation Software Quality Code Review Encodings Continuous Integration Cursor Python (Programming Language) Machine Learning
+21 more
Node.Js Systems Development Life Cycle Search Technologies Software Engineering Data Logging GitHub Copilot LangChain ReactJS Large Language Models Claude Code Prompt Engineering Generative AI Backend Langfuse — LLM Observability and Analytics Platform Solid Principles Production Code Machine Learning Operations Front End Software Development Restful APIs Golang Microservices

Job description

We are seeking seasoned full stack engineers with a passion for building AI-driven solutions to join our Shanghai team. These are full-ownership IC roles: you write production code, own features end-to-end from spec through deployment, operations, and observability, and you participate in on-call rotation for what your team ships. There is no handoff to a separate ops or reliability function; engineers own the full lifecycle. Test automation is built into how we ship using AI-driven tooling and the golden path., * Prototype, design, and develop innovative AI/ML solutions end to end, ranging from bots,agents to tools with a focus on generative models, large language models (LLMs), scalability, cost-efficiency, and compliance with industry standards .

  • Use AI-driven SDLC tooling such as Claude Code as a core part of your daily workflow, including code generation, spec-to-code translation, and automated test creation.
  • Write and maintain automated tests; quality is built in, not handed off.
  • Review pull requests, maintain code standards, and contribute improvements to the shared golden path.
  • Collaborate with product and design to refine specs before and during implementation.
  • Instrument services with logging, metrics, and alerts; participate in on-call rotation and own incident response for catalog services.
  • Build and maintain AI pipelines, including data digestion, preprocessing,, and monitoring.
  • Ensure AI systems comply with data privacy and security regulations.
  • Explore and implement prompt engineering, fine-tuning, and evaluation strategies.
  • Continuously monitor AI workflow performance metrics and implement improvements.

Requirements

  • 8+ years of software engineering experience. Fully autonomous; drives technical decisions within the team; mentors junior engineers.
  • Full stack experience. Backend development proficiency in one or more of: Python, nodejs, Go, Java. Python is the primary stack today. React or equivalent modern frontend framework.
  • Practical experience with LLM/ML orchestration framework such as LangGraph, LangChain, Langfuse or MLFlow.
  • Deep understanding of LLMs, including prompt engineering, retrieval-augmented generation (RAG), and fine-tuning techniques.
  • Proficiency in vector databases and embedding-based search technologies.
  • REST API design and microservice patterns.
  • AI-driven SDLC : hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor. The bar is not awareness; it is daily use in delivering real software.
  • Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoff.
  • Code quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CD.

NICE TO HAVE

  • Contributions to internal developer tooling, golden path standards, or SDLC process improvements.
  • Experience with e-commerce platforms, product catalogs, or high-traffic consumer applications.
  • Experience working in distributed teams across different time zones / geographies.
  • Track record of documenting architectural decisions, writing RFCs, or contributing to engineering wikis.

About the company

iHerb is one of the world’s largest e-commerce retailers of health, wellness, and beauty products, serving customers in more than 185 countries. With a catalog of over 30,000 products and global logistics infrastructure, we help millions of people live healthier lives every day. iHerb is growing its engineering organization around an AI-first mandate: using AI not just as a product feature but as the foundation for how we build software, serve customers, and operate the business., You will play a key role in shaping the future of how iHerb customers discover and engage with products by leveraging state-of-the-art innovations in AI/ML. Additionally, you will have the opportunity to develop impactful AI-powered models, services, and tools that are widely adopted across the organization.You will work across the full stack: backend services, React frontend, and vector data layers. Our current backend is Python; we also use Go, nodejs, and Java across the organization.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on arc.dev
Prepare application

Good distractions

Loading talks and stories from around this role…