Engineer, AI – AI Evaluation & Model Risk Lead

BrickRed Systems - Bellevue, WA

Hiring: Engineer, AI – AI Evaluation & Model Risk Lead Company: BrickRed Systems Location: Bellevue, WA Job Posted Time: 2026-09-15 10:25:14 Target Skills & Keywords : AI, Fine-tuning, Machine Learning, Python About the job Experience: •2+ years of professional experience in relevant AI, machine learning, software development, or data-focused roles. •3 years of related work experience •1 year of related work experience •4+ years of experience developing and deploying machine learning models •4+ years of experience with AI tools and software development using Python or R Required Skills: •And approved-use ratings that gate AI models into use. •Author and maintain model cards documenting what was tested, approved use cases, and identified risks. •AI evaluation harnesses and test suites aligned with established Safety Standards. •Lead and oversee security red-teaming and Responsible AI teams. •Partner cross-functionally with cross-functional teams to ensure effective integration and functionality of AI systems. Qualifications: •Bachelor's degree with 3 years of related work experience •, OR advanced degree with 1 year of related work experience •, OR equivalent combination of education and experience. •Degree in Computer Science, Engineering, Artificial Intelligence, Data Science, or related field preferred. •2–4+ years of experience developing and deploying machine learning models •, including fine-tuning and prompt engineering. •2–4+ years of experience with AI tools and software development using Python or R •2–4+ years of experience collaborating with cross-functional teams to integrate AI solutions into business workflows. •Strong knowledge of Cloud Computing •Strong experience in Data Analysis, Data Management, and Data Modeling Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!