Manager; AI Evaluation Engineering

Caterpillar Inc. - Chicago, IL

Hiring: Manager; AI Evaluation Engineering Company: Caterpillar Inc. Location: Chicago, IL Job Posted Time: 2026-09-10 10:34:17 Employment Type: Part-time / Hybrid Target Skills & Keywords : A/B Testing, AWS, Azure, CI/CD, Embedded Systems, Feature Flags, Fine-tuning, Foundry, GCP, LLM, LangChain, Phoenix, RAG, SageMaker, Snowflake, Systems Design About the job Required Skills: •Your Work Shapes the World at Caterpillar Inc. •Providing strong technical support and clear direction to ensure the team is aligned with company goals and capable of evaluating advanced AI projects. •Overseeing the performance of both individual team members and the team as a whole, fostering a culture of learning by identifying and addressing training and development needs. •Taking ownership of the quality of AI engineering products, making sure all solutions are robust, reliable, and meet high standards. •Establishing and supervising the implementation of engineering best practices to maintain consistency and excellence in development processes. •Products and Services: Knowledge of major products and services and product and service groups; ability to apply knowledge of product and service appropriately to diverse situations. •Software Development: Knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements. •Software Development Life Cycle: Knowledge of software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace. Compensation: •$147,760 - $240,110 / year •Medical, dental, and vision benefits* Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!