Hiring: Senior Software Engineer - GPU Local AI Platforms Company: NVIDIA Location: Austin, TX Job Posted Time: 2026-09-09 17:59:08 Employment Type: Full-time Target Skills & Keywords: GPU Computing, CUDA, Triton, LLM Inference, Python, C++, Docker, OCI, NCCL, RCCL, Quantization, Tensor Parallelism, KV-Cache, MoE, Speculative Decoding, CI/CD, Container Toolkit Experience: - 12+ years of software engineering with depth in GPU computing, ML systems, or high-performance inference - Hands-on experience with GPU kernel development or optimization (CUDA/C++, Triton, or equivalent) - Experience characterizing multi-node inference behavior and collective communication primitives (NCCL/RCCL) - Experience with container engineering: multi-architecture Docker or OCI builds, layer optimization, runtime configuration, NVIDIA Container Toolkit Required Skills: - Strong Python or C++ programming, software design, and software engineering skills - Deep understanding of GPU architecture: thread blocks, memory hierarchy, and warp execution - Working knowledge of LLM inference internals: attention mechanisms, KV-cache management, continuous batching, quantization formats, and tensor parallelism - Ability to analyze how new model architectures and inference algorithms (attention variants, MoE routing, speculative decoding, multi-token prediction, quantized inference) map onto NVIDIA GPU architecture - Strong analytical skills for performance analysis and reporting Qualifications: - BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience - Proven track record of tracking and evaluating innovations in open-source LLM inference frameworks - Experience owning model validation workflows and developing developer-facing inference recipes - Ability to engage with community and partners on model bring-up questions - Strong communication skills as a technical point of contact Compensation: Not specified in the provided job text. Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don’t miss this opportunity to join a forward-thinking team!