Staff Software Engineer — Search Platform, Ingestion & Indexing
Thomson Reuters - Brooklyn, NY
Hiring: Staff Software Engineer — Search Platform, Ingestion & Indexing Company: Thomson Reuters Location: Brooklyn, NY Job Posted Time: 2026-09-11 17:58:14 Employment Type: Full-time Target Skills & Keywords: Search Platform, Ingestion & Indexing, Kafka, Vespa, OpenSearch, Protobuf, Schema Registry, Stream Processing, Embeddings, Re-ranking Models, CI/CD, Model Serving, Distributed Systems, Python/Java (inferred from context), AI-assisted Development Experience: - Staff-level software engineering experience - Proven track record designing and operating large-scale distributed data pipelines - Experience with streaming architectures (Kafka or similar) - Experience with search engines (Vespa, OpenSearch, or similar) - Experience with schema management and serialization (Protobuf, schema registry) - Experience operationalizing ML models in production (inference serving, latency SLOs, batching, quantization) - Experience with CI/CD pipelines, canary rollouts, and rollback mechanisms Required Skills: - End-to-end ownership of document ingestion pipelines (parsing, chunking, enrichment, embedding, indexing) - Kafka-based stream processing with fault tolerance, version ordering, and at-least-once delivery guarantees - Designing pluggable, configurable pipeline components (parsers, chunkers, enrichers, indexers) - Protobuf-based document schema design and schema registry governance - Dual-flow ingestion design (high-throughput batch + low-latency incremental) - Migration experience from OpenSearch to Vespa (Vespa document processors, custom Kafka feeders, application package architecture) - Model lifecycle management (re-ranking, embedding, enrichment components) - Inference serving behind stable APIs, latency SLO management, hardware/runtime configuration - Model promotion pipelines (versioning, canary rollouts, rollback) - Full-stack ownership: define, build, test, deploy, scale, and operate shipped systems - AI-assisted development as daily practice - Constant delivery to production Qualifications: - Ability to set architectural boundaries, not just execute within them - Strong problem-solving skills for challenges with little or no precedent - Experience with zero-downtime operations at scale - Familiarity with agentic retrieval patterns and hybrid search engines - Background in legal, tax, or professional content corpora is a plus - This posting is for proactive recruitment purposes and may be used to fill current openings or future vacancies Compensation: Not specified in the provided text. Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don’t miss this opportunity to join a forward-thinking team!