Backend Engineer, AI Systems

ActAI - Palo Alto, CA

Hiring: Backend Engineer, AI Systems Company: ActAI Location: Palo Alto, CA Job Posted Time: 2026-09-15 17:59:14 Employment Type: Full-time Target Skills & Keywords: Python, Node.js, PyTorch, OpenAI/Anthropic/Open-source LLMs, SQL & NoSQL, Kubernetes, Docker, AI Inference, Orchestration, Distributed Systems, Observability Experience: - Strong backend engineering fundamentals in production environments. - Experience running high-throughput, low-latency services. - Familiarity with AI inference patterns (LLMs, embeddings, multimodal). - Comfortable debugging distributed systems under load. - Bias toward shipping and learning from production behavior. Required Skills: - Build and operate backend systems that serve AI-powered features in production. - Design inference pipelines and orchestration layers handling multi-step workflows, tool calls, and retries. - Manage the full lifecycle of AI requests: routing, caching, batching, streaming, and state management. - Optimize latency, throughput, and cost across model inference and downstream systems. - Design systems that remain reliable despite non-deterministic model behavior and external dependencies. - Implement observability for AI systems, including logging, tracing, and debugging of model outputs and failures. - Collaborate with ML and product teams to translate model capabilities into stable, production-grade APIs. Qualifications: - Ability to bring structure, exercise judgment, and execute independently. - Hands-on, high talent density team player comfortable with rapid iteration. - Experience with Python, Node.js, PyTorch, OpenAI/Anthropic/open-source LLMs, SQL & NoSQL, Kubernetes, and Docker. Compensation: Not specified. Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don’t miss this opportunity to join a forward-thinking team!