Hiring: Applied Scientist, Artificial General Intelligence, Frontier AI Company: Amazon Science Location: Bellevue, WA Job Posted Time: 2026-09-15 22:59:20 Employment Type: Full-time Target Skills & Keywords: Machine Learning, Large Language Models (LLMs), Multimodal Systems, Statistics, Quality Assurance, Auditing Methodologies, Automated Evaluation Systems, LLM-as-a-Judge, Python, Java, C++, SQL, RDBMS, Data Warehouse, Data Quality, Benchmarking Experience: - Experience programming in Java, C++, Python or related language - Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse - Experience implementing algorithms using both toolkits and self-developed code (preferred) - Publications at top-tier peer-reviewed conferences or journals (preferred) Required Skills: - Robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems - Designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies - Developing and maintaining LLM-as-a-Judge systems, including judge architectures and evaluation rubrics - Building machine learning models for automated quality assessment - Performing expert-level manual audits and meta-audits - Root cause analysis on data quality issues - Configuring data collection workflows and communicating quality feedback to stakeholders - Programming in Java, C++, Python or related language - SQL and RDBMS (e.g., Oracle) or Data Warehouse Qualifications: - Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field - Experience implementing algorithms using both toolkits and self-developed code (preferred) - Publications at top-tier peer-reviewed conferences or journals (preferred) Compensation: Not specified Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don’t miss this opportunity to join a forward-thinking team!