Software Engineer, Platform

People Culture Talent - San Francisco, CA

Hiring: Software Engineer, Platform Company: People Culture Talent Location: San Francisco, CA Job Posted Time: 2026-09-16 20:06:33 Employment Type: Remote Target Skills & Keywords : AI, API Gateway, AWS, Azure, GCP, Go, Kubernetes, LLM, PostgreSQL, Redis, SSE, Terraform About the job Experience: •5+ years of professional software engineering experience, focused on backend services, distributed systems, or developer-facing platforms. Required Skills: •The open AI evaluation platform redefining how the world's leading AI labs measure model performance is looking for a Software Engineer, Platform to help shape the future of how the world measures artificial intelligence. •They are building an AI gateway that gives developers access to multiple model providers through a unified endpoint. The product is in a private, gated launch, with additional platform capabilities—including direct model access—being built next. •You’ll help build the platform infrastructure that turns their research advantage into enterprise products. This is a founding role on the developer team. You’ll work directly with the founders and early customers to define what they build and how they build it. •Build and scale hands-on backend platform services for client's AI gateway, evolving an existing prototype into a reliable, independently scalable service. •Solve hard streaming problems. Handle SSE/streaming responses across heterogeneous providers, including partial failure recovery, mid-stream fallback, and consistent response normalization. •Ship reliable platform infrastructure, including capabilities such as authentication, rate limiting, usage metering, and cost tracking as the gateway matures. •Build deep observability. Instrument the platform with distributed tracing, latency breakdowns, usage tracking, and real-time dashboards so customers (and the team) can see exactly what’s happening. •Build AI-centered platform capabilities. Integrate with client's evaluation platform and data, and collaborate with research and product teams to turn new ideas into reliable product features. Qualifications: •API gateway, proxy, or multi-provider integration experience. •Exposure to LLM APIs, model serving, AI infrastructure, or evaluation platforms. •Cloud infrastructure experience across GCP, AWS, Azure, Kubernetes, Terraform, Postgres, or Redis. •Their openings span more than one career level. The starting salary for this role is $200k and could range up to $350k USD, plus equity. The provided salary depends on many factors, such as work experience and transferable skills, business needs and impact, and market demands. Compensation: •$200,000 - $350,000 / year •Comprehensive health, dental, vision, and additional support programs Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!