Hiring: Senior Principal Software Development Engineer, Consumer AI Architect Company: CarGurus Location: Boston, MA Job Posted Time: 2026-09-10 11:11:37 Employment Type: Hybrid Target Skills & Keywords : AWS, Java, LLM, LangChain, Python, REST, React, Systems Design About the job Experience: •10+ years of experience architecting resilient, scalable systems and leading technical direction across multiple teams with extensive experience designing, implementing, and deploying consumer-facing AI experiences in production Required Skills: •Design, build, and deploy consumer-facing experiences end-to-end to 45 million monthly visitors, from the data and model layer through to the user-facing product, being hands-on and actively participating in the implementation of select initiatives •Serve as a go-to AI expert and advisor for all Consumer AI projects, providing technical guidance on architecture, design, and implementation choices •Guide the platform and infrastructure decisions underpinning AI deployments, including storage, memory, request handling and load, evaluation pipelines, observability and analytics •Evaluate the broader AI framework and tooling landscape, independent of any single language or ecosystem, and guide teams toward the right approach for a given problem; develop proof-of-concepts to validate AI approaches and clearly explain the trade-offs between different technologies •Build and operate systems using LangChain, LangGraph, and Langfuse in Python to develop, orchestrate, and evaluate agentic and LLM-based applications in production •Strategically drive department's adoption of fully agentic programming, defining the patterns, tooling, and best practices engineers follow when building agentic systems •Partner with engineering leadership, product, and data teams to shape phased platform guidelines and roadmaps for consumer initiatives •Mentor engineers across teams on system design, evaluation methodology, and operational best practices Qualifications: •Applied hands-on capability in LangChain, LangGraph, and LangFuse in Python and with the platform and infrastructure layers of AI systems, including storage, memory, load management, evaluations, and observability •Broad knowledge of the AI framework and tooling landscape beyond Python, with the ability to evaluate and recommend approaches independent of language or ecosystem •Hands-on full stack experience building well-structured, performant applications across frontend, backend, and the platform and infrastructure layers for production-grade systems, including experience building APIs and REST services in Java and UX applications in React preferred •Strong communicator with a collaborative spirit who can influence technical direction across multiple teams and disciplines •The displayed range represents the expected annual base salary / On-Target Earnings (OTE) for this position. On-Target Earnings (OTE) is inclusive of base salary and on-target commission earnings, which applies exclusively to sales roles. •Individual pay within this range is determined by work location and other factors such as job-related skills, experience, and relevant education or training. •This annual base salary forms part of a comprehensive Total Rewards Package. In addition to benefits, this role may qualify for discretionary bonuses/incentives and Restricted Stock Units (RSUs). Compensation: •$191,000 - $239,000 / year Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!