Hiring: Software Engineer, Inference (AI Data Engineering) Company: SpaceX Location: Palo Alto, CA Job Posted Time: 2026-09-11 10:23:38 Employment Type: Remote Target Skills & Keywords : C++, CI/CD, ClickHouse, Docker, Kubernetes, LLM, Load Balancing, MongoDB, PostgreSQL, Python, REST, Rust, TensorRT, Triton, gRPC, vLLM About the job Experience: •Deep low-level systems programming and optimizations: GPU kernels, code generation, batching, caching, parallelism, quantization, and speculative decoding •Knowledge of service observability and reliability best practices •Expert knowledge of gRPC (unary, response streaming, bi-directional streaming, REST mapping) •Programming experience in Python, Go, or similar languages Required Skills: •Develop highly reliable, high-throughput inference systems that serve the best AI models internally across SpaceX •Architect and implement scalable distributed infrastructure for model serving, including load balancing, auto-scaling, batch scheduling, global KV cache, and continuous batching •Optimize latency and throughput of model inference under real production workloads, including low-level GPU kernel work, quantization, speculative decoding, and other acceleration techniques •Build reliable, high-concurrency serving systems with 100% uptime, low tail latency, and excellent observability •Own end-to-end components such as request routing, SDK development, rate limiting, and efficient scaling for internal SpaceX AI inference platforms •Benchmark, fine-tune, and accelerate inference engines (e.g., SGLang, vLLM, TensorRT-LLM) •Develop custom tools for tracing, replaying, and resolving issues across the full stack — from orchestration down to GPU kernels •Create robust CI/CD infrastructure for seamless endpoint deployment, image publishing, and inference engine updates Qualifications: •Bachelor's degree in computer science, engineering, math, or scientific discipline; OR 2+ years of professional experience building software in lieu of a degree •1+ years of experience in full stack development or backend development with production systems •1+ years of experience with Rust or C++ •You may be asked to work extended hours/weekends dependent on launch cadence and platform demands •This role requires you to be onsite in Palo Alto. Remote and/or hybrid work will not be considered •To conform to U.S. Government export regulations, applicant must be a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (aka green card holder), (iii) Refugee under 8 U.S.C. •1157, or (iv) Asylee under 8 U.S.C. •1158, or be eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR here. Compensation: •$135,000 - $175,000 / year Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!