Hiring: Senior Deep Learning Software Engineer, Inference Company: NVIDIA Location: New York, United States Job Posted Time: 2026-09-16 17:16:02 Employment Type: Full-time Target Skills & Keywords: Deep Learning Inference, GPU Acceleration, LLM, Generative AI, Multimodal AI, C/C++, Python, CUDA, CUTLASS, OAI Triton, NCCL, NVSHMEM, vLLM, SGLang, FlashInfer, PyTorch, Performance Optimization, Model Serving, Multi-GPU Communications, Software Design, Agile Experience: - 5+ years of relevant software development experience - Masters or PhD or equivalent experience in a relevant field (Computer Engineering, Computer Science, EECS, AI) - Prior experience with training, deploying, or optimizing the inference of DL models in production is a plus - Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus - GPU programming experience (CUDA, OAI TRITON, or CUTLASS) is a plus Required Skills: - Excellent C/C++ programming and software design skills - Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal, and Generative AI - Scaling performance of DL models across different architectures and types of NVIDIA accelerators - Contributing features and code to NVIDIA's inference libraries, vLLM and SGLang, FlashInfer, and LLM software solutions - Working with cross-collaborative teams across frameworks, NVIDIA libraries, and inference optimization - SW Agile skills are helpful and Python experience is a plus - Experience with Multi GPU Communications (NCCL, NVSHMEM) is a plus - Contributing to deep learning software projects, such as PyTorch, vLLM, and SGLang Qualifications: - Masters or PhD or equivalent experience in a relevant field (Computer Engineering, Computer Science, EECS, AI) - 5+ years of relevant software development experience - Excellent C/C++ programming and software design skills - Creative and autonomous engineer with a genuine passion for technology Compensation: - Base salary range: 152,000 USD - 241,500 USD for Level 3 - Base salary range: 184,000 USD - 287,500 USD for Level 4 - Eligible for equity and benefits - Base salary determined based on location, experience, and the pay of employees in similar positions Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don’t miss this opportunity to join a forward-thinking team!