Distinguished AI Engineer - Agentic AI Platform (Remote Eligible)
Capital One - New York, NY
Hiring: Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) Company: Capital One Location: New York, NY Job Posted Time: 2026-09-10 11:39:00 Employment Type: Full-time / Remote Target Skills & Keywords : AWS, Azure, C#, C++, Elasticsearch, GCP, Go, Helm, Java, Kubernetes, LLM, LangChain, LlamaIndex, Machine Learning, Python, RAG, SageMaker, Scala, Vertex AI About the job Experience: •8 years of experience programming with Python, Go, Scala, or Java •8+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud) •2+ years of experience supporting Agentic Frameworks (LangChain, CrewAI, Semantic Kernel (Microsoft), or AutoGen) •2+ years of experience with LLMOps (Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning) •8+ years of experience designing mission-critical machine learning platforms Required Skills: •Design the agentic workflow framework, shared services such as memory, guardrails, vector search, SDKs and blueprints that translate foundation model power into production grade applications used by millions of users across multiple lines of businesses. •Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One. •Contribute to the north star platform architecture, continuously publishing and refining living diagrams and canonical APIs that cover agent orchestration, RAG pipelines, prompt libraries and multi-tenant policy enforcement. •A major emphasis is around standardizing and automating agentic workflows : you will evaluate agentic frameworks such LangGraph, AutoGen, Semantic Kernal, CrewAI and LlamaIndex and then harden / blend patterns that best meet enterprise SLAs do that 90% of new apps adopt them. •Developer experience is another cornerstone. You will contribute to crafting an end to end GenAI SDK, CLI and starter kits that let AI engineers spin up secure, observable agentic workflows in under minutes, shrinking prototyping to production timelines by 30%. •Trust and safety remain paramount; you will help bring together a vision of central guardrail services - prompt firewalls, content-filter hooks, red team harnesses and audit APIs - consumed by every application to ensure zero Sev4 incidents. •You’ll own central Helm charts, operators and CRDs that auto scale agents to hit tenant SLAs •Finally you will coach and evangelize - hosting architecture office hours, mentoring Staff, Principal and Senior engineers, authoring technical design documents and blogs and representing Capital One at Tier1 AI conferences - to amplify platform vision across internal and external communities. Qualifications: •Bachelor's degree in Computer Science, Engineering, or AI plus at least 8 years of experience developing AI and ML algorithms or technologies, or Master's degree plus at least 6 years of experience developing AI and ML algorithms or technologies •Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level •Master's degree in Computer Science, Computer Engineering, or relevant technical field •Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers •Comprehensive expertise in Responsible AI, data privacy and multi-tenant security patterns •8 years of experience developing AI and ML algorithms or technologies, or Master's degree plus at least 6 years of experience developing AI and ML algorithms or technologies •At least 8 years of experience developing AI and ML algorithms or technologies, or Master's degree plus at least 6 years of experience developing AI and ML algorithms or technologies Compensation: •$269,100 - $307,200 / year •Flexible work environment (work from home / hybrid options) •This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI) Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!