Staff Software Engineer — Search Platform, Ingestion & Indexing
Thomson Reuters - Eagan, MN
Hiring: Staff Software Engineer — Search Platform, Ingestion & Indexing Company: Thomson Reuters Location: Eagan, MN Job Posted Time: 2026-09-11 17:58:14 Employment Type: Full-time (proactive recruitment for current or future openings) Target Skills & Keywords: Search Platform, Ingestion & Indexing, Kafka, Stream Processing, Vespa, OpenSearch, Protobuf, Schema Registry, Embeddings, Re-ranking Models, Entity Extraction, CI/CD, Canary Rollouts, Distributed Systems, AI-assisted Development Experience: - Staff-level software engineering experience - Proven track record architecting and operating large-scale, distributed data pipelines - Experience with Kafka-based streaming architectures and fault-tolerant, at-least-once delivery systems - Hands-on experience with search engines (Vespa and/or OpenSearch) and index management - Experience operationalizing ML models in production (inference serving, latency SLOs, scaling) Required Skills: - End-to-end design and ownership of document ingestion pipelines (parsing, chunking, enrichment, embedding, indexing) - Kafka stream processing with version ordering, idempotency, and fault tolerance - Pluggable, configurable pipeline component architecture (parsers, chunkers, enrichers, indexers) - Protobuf-based document schema design and schema registry governance - Dual-flow ingestion: high-throughput batch reindexing and low-latency incremental updates - Migration of ingestion infrastructure from OpenSearch to Vespa (document processors, custom Kafka feeders, application packages) - Custom model lifecycle management: re-ranking, embedding, and enrichment models; inference APIs; batching and quantization - Model promotion pipelines: CI/CD, versioning, canary rollouts, and rollback - Full-stack ownership: define, build, test, deploy, scale, and operate shipped systems - AI-assisted development and continuous delivery to production Qualifications: - Staff-level engineer who sets architectural boundaries, not just executes within them - Strong background in distributed systems and large-scale content/search platforms - Comfortable resolving complex technical challenges with little or no precedent - Experience with agentic retrieval patterns and hybrid search engines is a plus - Bachelor's degree in Computer Science or related field, or equivalent practical experience Compensation: Not specified in the job posting. Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don’t miss this opportunity to join a forward-thinking team!