Hiring: Staff Software Engineer, Inference Performance Optimization, GenAI, DeepMind Company: Google DeepMind Location: Mountain View, CA Job Posted Time: 2026-09-11 11:02:07 Target Skills & Keywords : AI, C++, LLM, Machine Learning, PyTorch, Python, TensorRT, vLLM About the job Experience: •8 years of experience in software development. Required Skills: •Learn more about benefits at Google . •Analyze and optimize AI inference workloads across the application, model, and distributed fleet infrastructure layers to methodically increase throughput-per-GPU and reduce latency. •Design and implement inference optimization techniques. •Investigate and resolve complex model inference performance bottlenecks across the stack. •Model the latency-to-cost impacts of system variables (such as batch-sizing and utilization goals) and translate these insights into actionable signals that drive production systems. •Develop investigative tools and metrics (e.g., compute/FLOPs funnels) that track where compute is spent across the fleet. Qualifications: •Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related technical field, or equivalent practical experience. •Operational familiarity with GPU/TPU/accelerator performance concepts (e.g. memory bandwidth, quantization, collective communication, kernel), and can reason their implications to the overall inference serving performance. •We are pushing the boundaries across multiple domains. Our global teams offer diverse learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort. •Individual pay is determined by factors including job-related skills, experience, and relevant education or training. •US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits Compensation: •US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!