Hiring: Lead ML Inference Engineer, Advertising Company: Roku Location: Austin, TX Job Posted Time: 2026-09-03 10:38:40 Employment Type: Remote Target Skills & Keywords : Machine Learning, Reinforcement Learning About the job Experience: •10+ years of experience in developing and deploying large-scale, distributed systems, with at least 5 years in a leadership or technical lead role •At least 5 years in a leadership or technical lead role Required Skills: •Architect, design, and lead the development of a SOTA Inference platform that can handle Advertising-level low latencies, scale, throughput, and availability with optimizations that span across hardware, software, and models. •We’re looking for a strong technical leader with deep experience in ML serving, high-performance computing, and industry standard frameworks - someone excited to mentor engineers, innovate at scale, and shape the future of machine learning at Roku. •Lead the design and development of a SOTA Inference platform •Oversee the development of monitoring, observability, and other tooling to ensure system and model performance, reliability, and scalability of online inference services •Identify and resolve system inefficiencies, performance bottlenecks, and reliability issues, ensuring optimized end-to-end performance •Stay at the forefront of advancements in inference frameworks, ML hardware acceleration,  and distributed systems, and incorporate innovations where and when they are impactful •We’re excited if you have •M.S. or above in CS, ECE, or a related field Compensation: •Competitive benefits and rewards package Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!