Hiring: Senior Staff Machine Learning Engineer, Data & Eval Company: Airbnb Location: United States Job Posted Time: 2026-09-03 02:13:06 Employment Type: Remote Target Skills & Keywords : A/B Testing, Agile, Data Pipeline, Fine-tuning, LLM, Machine Learning, Make, RAG, TestNG About the job Experience: •10+ years building, testing, and shipping ML/AI systems end-to-end; including 2+ years of experience with GenAI/LLM systems in production. •5+ years leading large, ambiguous technical initiatives as a senior IC, influencing roadmap and engineering/science direction across teams. Required Skills: •The Community You Will Join •Lead and oversee driving Airbnb Assistance Engineering initiatives by adopting Generative AI technologies to enable an intelligent, scalable, and exceptional service experience. •The Difference You Will Make •In this Senior Staff Machine Learning Engineering role, you will set technical direction and lead execution for ML evaluation and the end-to-end data flywheel powering Airbnb Assistance Engineering (e.g., assistive agents, issue resolution, and tooling). •Partner closely with product, engineering, design, operations to build evaluation systems that are trusted, scalable, and actionable - connecting offline metrics to online outcomes. Qualifications: •Educational Background: PhD in Computer Science, Mathematics, Statistics, or related technical field (or equivalent practical experience). •Industry Experience: 10+ years building, testing, and shipping ML/AI systems end-to-end; including 2+ years of experience with GenAI/LLM systems in production. •Leadership Experience: 5+ years leading large, ambiguous technical initiatives as a senior IC, influencing roadmap and engineering/science direction across teams. •Deep expertise in evaluation methodology (offline/online alignment, metric design, human-in-the-loop evaluation, A/B testing, power analysis, regression testing). •Applied hands-on capability in GenAI systems, including orchestration, retrieval, tool calling, memory, etc. •Experience building data pipelines and quality systems (labeling workflows, dataset curation, versioning, monitoring, and governance). •Solid ML fundamentals and best practices (model selection, training/serving, monitoring, reliability, and model lifecycle management). •Customer Support Systems: Experience applying ML/AI to customer support workflows (e.g., agent assist, classification/routing, resolution recommendation, QA). •Infrastructure & Quality at Scale: Experience building robust evaluation platforms for agent behavior validation, safety/guardrails, and continuous improvement. •Agile Practice for Applied AI: Proven ability to take evaluation and data flywheel work from incubation to production, iterating quickly while maintaining scientific rigor. Compensation: •$244,000 - $305,000 / year Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!