Hiring: Sr. Software Engineer II - AI Company: iHerb Location: United States Job Posted Time: 2026-09-16 11:17:50 Target Skills & Keywords : CI/CD, GitHub, LLM, LangChain, LlamaIndex, MLOps, Python, RAG, Systems Design About the job Experience: •10+ years of software engineering experience. Required Skills: •Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation. •Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability. •Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces. •Evaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using data. •Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code. •Coordinate with the Personalization team to align GenAI product features with existing ML personalization signals. •Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base. •Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents. Qualifications: •AI-driven SDLC : hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor. The bar is not awareness; it is daily use in delivering real software. •Full-stack awareness: comfortable contributing across layers of the stack when needed; purely single-layer specialists are not the target profile. •Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoff. •Code quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CD. •Fully autonomous; drives technical decisions within the team; mentors junior engineers. •Python proficiency; comfortable building and operating production LLM applications. •Applied hands-on capability in at least one specialization: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM-based workflow automation. •Understanding of prompt engineering, context window management, and LLM output quality tradeoffs. •Operational familiarity with vector databases, embedding models, or semantic search. •High degree of accuracy and attention to detail Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!