Hiring: ML Engineer — LLM Evaluation Company: Dynamo AI Location: San Francisco, CA Job Posted Time: 2026-09-17 10:13:06 Target Skills & Keywords : LLM About the job Required Skills: •Own LLM evaluation processes and methods with a focus on generating benchmarks representative of real-world usage and safety vulnerabilities. •Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking. •Deliver robust, scalable, and reproducible production code. •Push the envelope by developing methods for benchmarking that revamps how we assess the best LLMs for harmlessness and helpfulness. Your research will directly empower our customers to more feasibly deploy safe and responsible LLMs. •Co-author papers, patents, and presentations with our research team by integrating other members’ work with your vertical. Qualifications: •Domain knowledge in LLM evaluation and data curation techniques. •Extensive experience in designing and implementing LLM benchmarking, extending previous methods. Comfortability with leading end-to-end projects. •Adaptability and flexibility. In both the academic and startup world, a new finding in the community may necessitate an abrupt shift in focus. You must be able to learn, implement, and extend state-of-the-art research. •Preferred: past research or projects in benchmarking LLMs. •Salary for this position may vary based on several factors, including the candidate's experience, expertise, and the geographic location of the role. Compensation is determined to ensure competitiveness and equity, reflecting the cost of living in different regions and the specific skills and qualifications of the candidate. Compensation: •Flexible work environment (work from home / hybrid options) •We strive to ensure our practices promote fairness, equity, and transparency for all candidates Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!