Hiring: GDM Staff Software Engineer, Agent Data Quality, DeepMind Company: Google DeepMind Location: Mountain View, CA Job Posted Time: 2026-09-10 11:02:07 Target Skills & Keywords : AI, Data Pipeline, LLM, Machine Learning, NLP About the job Required Skills: •Learn more about benefits at Google . •Construct rigorous quantitative benchmarks and automated evaluation frameworks (including LLM-as-a-judge) to measure agent capabilities in reasoning, planning, and tool use. •Develop end-to-end data flywheel on agent evalset curation, and automate and productionize the flywheel with agentic data pipelines. •Develop a dedicated platform for "Self-Service Judges," allowing researchers to rapidly prototype and test new LLM-based classifiers and annotations against historical trajectory data. •Establish a formal ecosystem for metric lifecycle management, including a sandbox for validating new metrics against a library of high-confidence calibration experiments. •Productionize automated insights tools to identify the top movers of metric deltas across complex slices such as task type and user cohort. Qualifications: •Bachelor's degree in Computer Science or Engineering, or equivalent practical experience. •MBA or Master's degree in Computer Science. •We are pushing the boundaries across multiple domains. Our global teams offer diverse learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort. •Individual pay is determined by factors including job-related skills, experience, and relevant education or training. •US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits Compensation: •US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!