Hiring: Agentic AI, Senior Software Development Engineer Company: Zillow Location: United States Job Posted Time: 2026-09-10 10:17:20 Employment Type: Remote Target Skills & Keywords : Databricks, LLM, LangChain, MLflow, Machine Learning, User Experience About the job Experience: •4+ years of backend engineering experience, with a track record of designing, shipping, and operating scalable production ML services Required Skills: •We are seeking a collaborative, product-minded backend engineer with strong Agentic AI fundamentals and a passion for building reliable, scalable systems that power AI applications. •Design, build, and scale evaluation frameworks for Zillow’s agentic AI experiences. •Build tracing, observability, and quality measurement systems for production AI agents. •Create platform infrastructure that enables domain teams across Zillow to build on top of the Evals platform without bottlenecks. •Partner with applied scientists and machine learning engineers to integrate new AI evaluation capabilities into production systems. •Help evolve how Zillow measures AI quality, reliability, trustworthiness, and product impact. •Stay current with emerging agentic AI paradigms, evaluation techniques, and LLM tooling, and translate them into practical platform innovation. •Support scaling, reliability, performance optimization, incident response, and cost management for the evaluation layer. Qualifications: •You are a roll-up-your-sleeves technical expert who can combine state-of-the-art AI technology with large-scale backend engineering. You thrive in ambiguous environments, enjoy solving challenging problems, and care deeply about creating reliable systems that other teams can trust. •Applied hands-on capability in ML Evals & Observability frameworks (Databricks MLflow, or evolving LLM frameworks preferred - LangSmith, Braintrust, Promptfoo, or similar) •Fluency working across applied science, ML, product, design, and engineering; you translate between disciplines without losing precision •Comfort with LLMs, agentic systems, and evaluation frameworks; familiarity with orchestration tools (LangChain, LangGraph, MCP, or similar) •A habit of reaching for AI-assisted development tools in your own workflow; you don't just build for AI, you build with it •Strong ownership and a growth mindset; you're energized by ambiguity, not slowed by it •Advanced degree in Computer Science, Machine Learning, or a related field, or equivalent practical experience building products using frontier LLMs, multimodal models, or agent-based systems •How we work is a key part of that transformation. Through Cloud HQ, our strategic approach to distributed work, most employees have the flexibility to work from wherever they’re most productive—enabling us to move fast, stay connected and deliver on our people promise. •Zillow is honored to be recognized among the best workplaces in the U.S. Zillow was named one of FORTUNE 100 Best Companies to Work For® in 2026, and included on TIME’s America’s Best Companies 2026 list, reflecting our commitment to creating an innovative, inclusive, and engaging culture where employees are empowered to grow. Compensation: •Flexible work environment (work from home / hybrid options) Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!