Hiring: Staff Product Manager, Market Place Company: Recruiting from Scratch Location: San Francisco Bay Area Job Posted Time: 2026-09-17 09:50:12 Employment Type: On-site Target Skills & Keywords : LLM, Machine Learning, Product Management, SQL About the job Experience: •8+ years of Product Management experience, preferably building platform, infrastructure, developer, or internal-facing products. Required Skills: •We're representing one of the fastest-growing AI infrastructure companies building the connection between human expertise and frontier AI models. Their platform enables leading AI labs and Fortune 500 companies to build, evaluate, and deploy AI systems powered by high-quality human intelligence. •Own the strategy, roadmap, and execution for the company's shared LLM gateway platform. •Define product requirements for model routing, priority scheduling, rate limiting, usage policies, and access controls. •Design scalable systems that balance latency, throughput, reliability, and infrastructure costs across multiple AI workloads. •Build transparent cost attribution and usage reporting that enables teams to understand and optimize model consumption. •Partner closely with Infrastructure Engineering to translate platform constraints into scalable product capabilities. •Develop policies that govern shared AI resources while enabling product teams to move quickly. •Analyze usage patterns, infrastructure metrics, and business outcomes to prioritize platform investments. Qualifications: •Operational familiarity with LLM gateways, model routing, AI inference infrastructure, or distributed compute platforms. •In-depth knowledge of capacity planning, workload prioritization, and platform governance. •Startup experience building foundational platform capabilities from the ground up. •Comfortable prototyping lightweight technical solutions using AI-assisted development tools. •Passion for AI infrastructure, platform engineering, and enabling high-performing engineering organizations. Compensation: •$180,000 - $300,000 / year Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!