Senior Software Engineer, Bulk/Interactive Inference

Waymo - Mountain View, CA

Hiring: Senior Software Engineer, Bulk/Interactive Inference Company: Waymo Location: Mountain View, CA Job Posted Time: 2026-09-15 17:59:48 Employment Type: Full-time Target Skills & Keywords: C++, Distributed Systems, ML Inference, Model Hosting, LLMs, Scalable Infrastructure, ML Pipelines, Throughput Optimization, Latency Optimization, MLOps Experience: - 5+ years of professional experience in the field of software engineering - Experience building highly scalable distributed systems - Experience with building model hosting and inference solutions (preferred) - Experience handling datasets in the order of exabytes (preferred) Required Skills: - Proficiency in C++ - Building highly scalable distributed systems - Developing scalable, high-throughput, low-latency inference platforms - Deploying and integrating model inference solutions across use cases such as distillation, eval, dataset generation, active learning, and auto-labeling - Collaborating with cross-functional teams to host internal and external ML models, including LLMs - Improving inference efficiency on large models to increase throughput and reduce cost Qualifications: - Passion for building internal infrastructure and tools - Strong collaboration skills working across teams - Ability to work in a hybrid environment - Reports to the Head of ML Platform - Senior Staff Software Engineer Compensation: - Base salary range: $213,000—$263,000 USD - Eligible for discretionary annual bonus program, equity incentive plan, and generous company benefits program (subject to eligibility requirements) Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don’t miss this opportunity to join a forward-thinking team!