Hiring: Senior Staff Engineer - AI ADC Company: A10 Networks, Inc Location: San Francisco Bay Area Job Posted Time: 2026-09-12 10:46:34 Target Skills & Keywords : C, C++, DNS, Go, HTTP/2, LLM, Load Balancing, Node.js, Product Management, PyTorch, Python, QUIC, TLS, TensorFlow About the job Required Skills: •Lead architecture and development of AI Gateway components for intelligent routing of LLM/AI application traffic. •Design and implement LLM‑aware load balancing, incorporating semantic, token, latency, and model‑level insights into traffic decisions. •AI model endpoint discovery and health checks •Integration with vector databases, model registries, and ML observability systems •Contribute to advanced features including Layer‑8 context‑aware routing, adaptive traffic shaping, and AI‑driven anomaly detection. •Drive system‑wide architecture: data plane, control plane, configuration, and distributed state management. •Mentor engineering teams on AI workload behaviors, traffic characteristics, and tuning strategies. •Partner cross-functionally with AI research and platform teams to align architectural decisions with product roadmap. Qualifications: •Advanced degree in Computer Science, Networking, or related field (MS/PhD preferred). •Deep knowledge of L4–L7 protocols (TCP/TLS/HTTP/2/3, QUIC), load balancing algorithms and GSLB strategies (DNS‑based, HTTP redirect, anycast). •Strong programming skills in C/C++ (data plane), Go/Python (control/ML), and performance profiling (perf, eBPF, flamegraphs, VTune/nvprof). •Applied ML: anomaly detection, time‑series forecasting, classification; experience with PyTorch/TensorFlow. •Model inference pipelines, LLM API integrations •Token‑level behavior and performance characteristics •Understanding of AI workload routing challenges (latency, caching, batching, multi‑model orchestration) •Strong architectural and design skills; able to lead complex technical initiatives end‑to‑end. •Demonstrated ability to influence cross‑functional teams and drive consensus. •Passion for emerging AI technologies and applying them within network infrastructure. Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!