Systems Architect AI/ML Infrastructure
Deepgram - United States
Hiring: Systems Architect AI/ML Infrastructure Company: Deepgram Location: United States Job Posted Time: 2026-09-10 10:21:13 Employment Type: Hybrid Target Skills & Keywords : AWS, Cloudflare, Data Pipeline, Kubernetes, Systems Design, Twilio About the job Experience: •000 years of audio and transcribed more than 1 trillion words. There is no organization in the world that understands voice better than Deepgram. •7+ years of experience in infrastructure engineering, systems architecture, or a senior technical role focused on large-scale infrastructure Required Skills: •Define and drive the end-to-end infrastructure architecture for Deepgram's AI/ML workloads across production inference and research training •Design multi-cloud and hybrid infrastructure strategies that balance performance, reliability, cost, and vendor flexibility •Architect compute orchestration systems that efficiently schedule and manage GPU and CPU workloads across heterogeneous infrastructure •Design storage architectures that handle the massive datasets required for speech and audio ML -- from high-throughput training data pipelines to low-latency model serving •Lead capacity planning across all infrastructure dimensions, modeling growth and ensuring Deepgram can scale ahead of demand •Drive cost optimization and FinOps practices, identifying opportunities to reduce infrastructure spend without compromising performance or reliability •Design burstable, elastic training infrastructure that can scale up for large training runs and scale down to minimize idle cost •Architect research compute infrastructure that gives ML teams the resources they need while maintaining operational efficiency Compensation: •Flexible work environment (work from home / hybrid options) Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!