Product Manager, Agent Harness & Modelling

Cohere - New York, NY

Hiring: Product Manager, Agent Harness & Modelling Company: Cohere Location: New York, NY Job Posted Time: 2026-09-10 10:17:40 Employment Type: Full-time / Remote Target Skills & Keywords : CV, LLM, RAG About the job Experience: •5+ years of product management experience as a research PM, in agentic AI systems,, or applied ML products Required Skills: •Own how our Agents manage the context window as a deliberately controlled resource. This includes progressive disclosure of tools and skills, context compaction and summarization, offloading of large payloads to a persistent filesystem, and the instrumentation that keeps agents oriented across extended trajectories. •Own the feedback loop between North's harness and the Modeling Team. This PM is the connective tissue that makes that possible: ensuring harness design decisions are validated by Modeling before they are built, that evals are the shared bridge between both teams, and that as the harness evolves the model evolves with it. •Define and own the roadmap for North's agent harness, including the agent loop, context engineering layer, tool orchestration, sandbox execution, and sub-agent delegation •Serve as the primary interface between North engineering and Cohere's Modeling team, ensuring new harness capabilities are validated before being built and that neither team paints itself into a corner •Own North's agentic evaluation framework, ensuring evals are compatible with both the North harness and Modeling's training infrastructure, and that they serve as a reliable bridge between product and research •Engage enterprise customers to surface real-world agentic failures and translate findings into concrete product and model requirements •Partner with the agentic expert modeling team to define goals that maximize the impact of our models and prioritize model capabilities and evals most critical for delivering on those goals. Establish a clear roadmap for our agentic modeling capabilities. •Stay current with the open-source and commercial agent ecosystem and drive adoption decisions that keep North's architecture aligned with emerging standards. Qualifications: •Comprehensive expertise in agentic harnesses, including the latest paid and open source offerings. •Comprehensive expertise in modern LLM agent architectures, including multi-agent systems, tool-augmented reasoning, memory and retrieval, programmatic orchestration, RAG, and long-horizon execution •Strong grasp of agentic evaluation design, including how to measure task completion, failure recovery, and long-horizon reliability, and how to diagnose model vs. scaffolding gaps •Technically deep enough to contribute to architecture decisions at the implementation level: comfortable reviewing and shaping design docs, reasoning about async execution patterns, sandboxed environments, filesystem design, and the tradeoffs that come with building harness capabilities into a production platform •Demonstrated capacity to flex between ML research conversations and engineering architecture discussions with equal fluency •Track record of shipping platform-layer products with demonstrated impact on reliability, performance, or capability. •Direct experience in developing and shipping leading agentic harnesses. •An active practitioner of agent frameworks who regularly builds with and follows the latest developments in open-source harnesses, coding agents, and orchestration tools in both professional and personal work •Applied hands-on capability in enterprise agentic deployments: multi-tenant orchestration, tool permissioning, audit trails, and compliance requirements •Operational familiarity with infrastructure constraints relevant to enterprise deployments: on-premises environments, scalability challenges, and the operational tradeoffs of running complex agent workloads in restricted or air-gapped settings Compensation: •Flexible work environment (work from home / hybrid options) Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!