Hiring: Senior AI Engineer Company: Crexi Location: Los Angeles, CA Job Posted Time: 2026-09-10 10:20:17 Employment Type: Remote Target Skills & Keywords : AWS, CI/CD, GitHub, GitLab, LLM, LangChain, Python, RAG About the job Experience: •5+ years of professional software development experience in production environments with meaningful scope/ownership, including 2+ years hands-on building LLM-powered applications in production. Required Skills: •Design and implement multi-step agentic workflows, including routing, planning, tool use, and state management, using frameworks like LangGraph/LangChain to move from user intent to real, completed actions. •Build evaluation frameworks and production monitoring (offline evals, human-in-the-loop annotation) to measure quality, reliability, and business outcomes, not just model metrics. •Build context and retrieval pipelines over Crexi's proprietary CRE data, handling the compound, qualitative queries that structured filters can't answer. •Work primarily with Anthropic frontier models on AWS Bedrock, using Bedrock AgentCore for agent runtime, identity, and memory, and helps evaluate open-weight alternatives on cost, latency, and capability. •Implement guardrails, structured outputs, and graceful ambiguity handling so agentic systems ask for clarification rather than acting on unclear intent, and establishes trace-level observability across LLM calls and tool invocations. •Leverage agentic coding tools (e.g., Claude Code, Codex) for scaffolding, refactoring, test generation, and debugging, while critically reviewing AI-generated output for correctness, security, and performance. •Rapidly prototype against real user feedback, partnering with Product and Design, and helps convert successful prototypes into scalable, reusable capabilities. •Ensure AI outputs are explainable, source-linked, and trustworthy enough to inform real business decisions. Qualifications: •Real experience with agentic architectures (multi-step pipelines, tool/function calling, state machines, memory), ideally with LangGraph or similar orchestration frameworks. •Strong retrieval design skills: RAG systems, embeddings, vector search, and the judgment to know when retrieval is the problem and when the data is. •Strong Python proficiency and real-world experience building backend services and APIs in production. •Demonstrated use of agentic coding tools (e.g., Claude Code, Codex) in a professional workflow, without compromising quality. •Comfortable operating in ambiguity and fast iteration cycles; experience designing LLM evaluation pipelines (offline evals, production monitoring, human-in-the-loop annotation) is a plus. •Bachelor’s degree in Computer Science or related field, or equivalent practical experience. •Thrives in a fast-paced, dynamic environment. •Exceptional communication skills, with the ability to provide clear and concise information to stakeholders at all levels of the organization. •Strong analytical skills, with the ability to interpret complex information, identify patterns, and present insights clearly and accurately. •Excellent organizational and prioritization skills, with the ability to manage multiple priorities and deadlines simultaneously. Compensation: •$179,000 - $241,000 / year •Flexible work environment (work from home / hybrid options) •Equity in Crexi's growth story Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!