Hiring: Staff Software Engineer, Inference Infrastructure Company: Cohere Location: New York, NY Job Posted Time: 2026-09-10 10:17:39 Employment Type: Full-time / Remote Target Skills & Keywords : AWS, Azure, C++, CV, GCP, Go, Kubernetes, LLM, Linux, Machine Learning, NLP, OCI About the job Experience: •5+ years of engineering experience running production infrastructure at a large scale Required Skills: •Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. •Lead and oversee developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints. •Work closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments. •Also get the opportunity to interface with customers and create customized deployments to meet their specific needs. Compensation: •Flexible work environment (work from home / hybrid options) Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!