Hiring: Member of Technical Staff, Model Efficiency Company: Cohere Location: New York, NY Job Posted Time: 2026-09-09 18:05:34 Employment Type: Full-time / Remote Target Skills & Keywords : C++, Go, LLM, Python, Rust, Transformers, vLLM About the job Experience: •5+ years of experience writing high-performance, production-quality code Required Skills: •As an engineer on this team, you’ll work across the inference stack to improve core performance metrics by diving deep into model execution, identifying bottlenecks, and developing innovative optimizations. You’ll collaborate closely with modeling and systems teams to experiment, measure, and ship improvements that meaningfully accelerate inference. As the team evolves, you’ll have opportunities to build expertise in advanced performance techniques, including GPU/CUDA optimizations, kernel-level improvements, and model execution strategies for MoE and large-scale architectures. Qualifications: •5+ years of experience writing high-performance, production-quality code •Strong programming skills in C++ or Python (Rust/Go also welcome) •Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang, etc.) •Ability to diagnose and resolve performance bottlenecks across the model execution stack •A strong bias for action — you ship fast, measure impact, and iterate •It’s a big plus if you have experience with: •GPU programming, CUDA, or low-level systems optimization •Language modeling with transformers (MoE, speculative decoding, KV-cache optimizations) •Scaling performance-critical distributed systems (e.g., computation, search, storage) •Working Location: •This role can be based remotely or from one of our office locations listed on the job description - there is no minimum in-office qualification requirement. We care most about hiring exceptional people regardless of locations, though please check the location listed on the posting for guidance around the core time zone or working hours alignment expected for the role. •Full-Time Employees At Cohere Enjoy These Perks •A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch. •Full health and dental benefits, including a separate budget for m Compensation: •$75 Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!