Senior Backend Engineer
People In AI - San Mateo, CA
Hiring: Senior Backend Engineer Company: People In AI Location: San Mateo, CA Job Posted Time: 2026-09-09 18:02:23 Employment Type: Hybrid Target Skills & Keywords : Data Pipeline, HBase, LLM, Machine Learning, Make, SaaS About the job Required Skills: •This is a broad, high-ownership engineering role sitting at the intersection of backend systems, AI agent infrastructure, data orchestration, and production ML. •A major part of your work will involve building the agent harnesses and runtime infrastructure surrounding AI models: the systems responsible for orchestrating agents, managing tool execution, coordinating multi-step workflows, maintaining state, handling failures, evaluating outputs, and connecting models to the data and services they need. •You’ll also build the backend services and data pipelines that underpin the wider platform, working with complex geospatial, regulatory, and multimodal datasets. •Rather than simply integrating an LLM API into an application, you’ll be helping answer the harder engineering questions around how agentic systems actually operate reliably in production. •You’ll own meaningful capabilities from initial prototype through architecture, implementation, deployment, observability, and iteration. •What You’ll Do •Design and build production-grade backend services powering an AI-native SaaS platform. •Build agent harnesses and execution infrastructure for sophisticated AI workflows. •Develop systems for orchestrating multi-step agent interactions across models, tools, APIs, databases, and internal services. •Design reliable abstractions around tool calling, structured outputs, state management, context management, retries, fallbacks, and failure recovery. •Build agent runtimes capable of supporting both dynamic model-driven behaviour and deterministic application logic. •Develop infrastructure for agent evaluation, tracing, debugging, observability, and performance monitoring. •Create guardrails and execution patterns that make agentic workflows reliable enough for production use. •Work on model routing, inference workflows, asynchronous execution, and long-running AI tasks. •Partner closely with AI engineers to turn experimental agents and ML capabilities into scalable production systems. Compensation: •$250,000 - $300,000 Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!