Applied Scientist/Research Engineer, LLM Training Data
Propio Language Services - Overland Park, KS
Hiring: Applied Scientist/Research Engineer, LLM Training Data Company: Propio Language Services Location: Overland Park, KS Job Posted Time: 2026-09-11 07:41:58 Employment Type: Full-time Target Skills & Keywords : AI, AWS, Data Pipeline, ECS, EKS, IAM, LLM, Lambda, Machine Learning, NLP, Python, S3, SQL, SageMaker, Step Functions About the job Experience: •4+ years of experience in AI data, ML data operations, NLP data engineering, applied ML, speech/translation data, or LLM data workflows. Required Skills: •Define the end-to-end data roadmap for multilingual and multimodal AI systems, including text, speech, translation, interpretation, low-resource languages, and agentic AI workflows. •Design and build dataset curation pipelines for training, post-training, and evaluation, including cleaning, deduplication, filtering, PII redaction, quality scoring, sampling, balancing, and versioning. •Create annotation schemas, labeling guidelines, QA rubrics, golden datasets, and reviewer workflows for multilingual, speech, translation, and vision data. •Build evaluation datasets and benchmarks, analyze model failure modes, and translate performance gaps into targeted data improvements. •Support post-training data workflows such as SFT, instruction tuning, preference data, RLHF/DPO-style data, reward model data, and synthetic data generation. •Use modern annotation tools and AWS-based data infrastructure to scale secure, traceable, and compliant AI data workflows. Qualifications: •Master’s degree in Computer Science, Machine Learning, Data Science, Computational Linguistics, Linguistics, Statistics, or a related field, or equivalent practical experience. •Strong hands-on experience with Python, SQL, and dataset curation pipelines. •Operational familiarity with multilingual NLP, speech data, translation data, low-resource languages, conversational AI, or agentic AI datasets. •Solid functional working knowledge of AWS data and ML tools such as S3, Glue, SageMaker, Bedrock, Lambda, Step Functions, EKS/ECS, IAM, or KMS. •Strong communication skills and ability to work with ML engineers, applied scientists, product teams, linguists, data teams, and vendors. •PhD in Computer Science, Machine Learning, NLP, Computational Linguistics, Data Science, Statistics, or a related field. •Notice of AI Use in Job Application Review Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!