Hiring: Senior Software Engineer - Together Cloud Platform Company: Together AI Location: San Francisco, CA Job Posted Time: 2026-09-03 10:59:36 Employment Type: Full-time / Remote Target Skills & Keywords : AWS, Airflow, Azure, CI/CD, Fine-tuning, GCP, Go, IaC, Kafka, Kinesis, Kubernetes, LLM, Microservices, PostgreSQL, Reinforcement Learning, Salesforce, Zoom About the job Experience: •5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices Required Skills: •Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. •Some Of What You’ll Work On •Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters. •Build out a global management plane for managing our data center compute, networking, and storage. •Design and build new customer-facing cloud platform services, delivering killer enterprise AI cloud features. •Identify, design, and develop foundational backend services that power Together’s cloud platform •Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure •Partner with product teams to understand functional requirements and deliver solutions that meet business needs Qualifications: •Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members •Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP) •Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale •Expert-level programmer in one or more of programming language (Golang preferred) •Proficiency in version control practices and integrating IaC with CI/CD pipelines. •Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience Compensation: •$160,000 - $230,000 / year •Flexible work environment (work from home / hybrid options) •We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!