Senior Product Manager - AI Platform Inference
NVIDIA - Santa Clara, CA
Hiring: Senior Product Manager - AI Platform Inference Company: NVIDIA Location: Santa Clara, CA Job Posted Time: 2026-09-02 17:59:07 Employment Type: Full-time Target Skills & Keywords: Inference, Generative AI, vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO, GPU Architecture, HW/SW Co-design, Performance Profiling, Open Source, Product Strategy, Roadmaps, Go-to-Market, Machine Learning, Model Optimization Experience: - 6+ years of technical product management, or similar, experience at a technology company - Experience with Inference deployment and optimization software (e.g., vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO, etc.) - Demonstrable knowledge of GenAI or machine learning concepts, particularly around performance optimization, software development, and delivery Required Skills: - Create products to help developers build better Inference deployments - Develop product strategy, roadmaps, and go-to-market plans - Collaborate with internal and external developers to build product-based roadmaps for model optimization software - Work with leadership to align with and drive company strategy - Strong communication and interpersonal skills Qualifications: - BS or MS degree in Computer Science, Computer Engineering, or similar experience (or equivalent experience) - Experience leading optimization products for Inference (preferred) - Working on Open Source & GitHub-first developer products with deep customer interactions (preferred) - Knowledge of GPU architecture, HW/SW co-design, and performance profiling (preferred) Compensation: - Base salary range: 168,000 USD - 258,750 USD for Level 4 - Base salary range: 208,000 USD - 327,750 USD for Level 5 - Eligible for equity and benefits Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don’t miss this opportunity to join a forward-thinking team!