Hiring: Sr. Manager, Test Automation & AI Evaluation Company: WebMD Location: Newark, NJ Job Posted Time: 2026-09-16 19:05:15 Employment Type: Full-time Target Skills & Keywords : CI/CD, Cypress, LLM, Playwright, Quality Assurance, Selenium About the job Experience: •7+ years of experience in quality engineering or test automation, including team leadership or management. Required Skills: •Lead an automation-first quality strategy, eliminating manual testing waste and making automated testing the default across teams. •Own modern test automation frameworks and end-to-end automated coverage, with deep, current expertise in Playwright and comparable frameworks. •Build and own evaluation frameworks for LLM-powered features and agentic systems, covering correctness, hallucination, prompt drift, and behavioral regression. •Establish and maintain evaluation methodology such as curated golden sets, LLM-as-judge approaches calibrated against subject-matter experts, and continuous learning loops that feed production failures back into the benchmark. •Own standardization of quality engineering practices across the organization, driving accountability for test coverage, defect management, release readiness, and overall delivery quality. •Provide direct management, mentorship, and structure to the existing Ignite quality assurance function. •Actively facilitate and support development of a scalable Quality Management System to ensure consistency, traceability, and process rigor across teams. •Partner with engineering, product, and DevOps to define acceptance criteria and embed quality gates into the delivery lifecycle. Qualifications: •Deep, current, hands-on expertise in modern test automation frameworks such as Playwright, Cypress, or Selenium. •Demonstrated experience building automated test suites and integrating them into CI/CD pipelines. •In-depth knowledge of test strategy, defect management, and release-readiness governance across multiple teams. •Proven ability to lead, mentor, and grow a quality engineering team. •Excellent communication skills and the ability to translate quality risk into business terms. Compensation: •$98,000 - $135,000 / year •Bonus Eligible: This position is also eligible for a discretionary company bonus, based upon business results Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!