Hiring: Distinguished Architect, AI Company: Datadog Location: New York, NY Job Posted Time: 2026-09-16 10:44:55 Employment Type: Hybrid Target Skills & Keywords : Accessibility, Datadog, LLM, Product Management, Stakeholder Management About the job Experience: •10+ years of experience with at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure. Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks. Required Skills: •Act as a technical multiplier for the world's leading AI labs and AI-native companies. •Bridge the gap between their bleeding-edge infrastructure aspirations and Datadog’s technology roadmap, ensuring our platform natively solves the unique observability challenges of training and deploying foundational models at scale. Qualifications: •Industry Experience: 10+ years of experience with at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure. Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks. •Strategic Thinker: Able to think long term and creatively about a wide variety of technical and business challenges •Stakeholder Management: Proven experience interacting with and influencing elite individual contributors, research scientists, and technical founders in flat, rapid-growth environments. •Technologist: A true close-to-the-metal technologist who maintains deep hands-on credibility and can white-board architectural solutions seamlessly with senior engineers. Strong understanding of best practices and real world challenges AI/LLM Ops and LLM Observability (LLMO). •Presenter: Excellent customer-facing presentation skills for large audiences, comfortable discussing complex technical details as well as with briefing executives or non-technical personas. •Communicator: Excellent verbal and written communication skills, ability to link product functionality to business objectives, value realization and ROI. •Travel: Able to travel via auto, train or air up to 50% of the time •Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. Compensation: •$330,000 - $440,000 / year •New hire stock equity (RSUs) and employee stock purchase plan (ESPP) Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!