Senior Software Engineer - Together Cloud Platform at Together AI
- Company: Together AI
- Location: San Francisco
- Employment type: Full-time
- Posted: 2025-06-04
- Technologies: Kubernetes, Fine-Tuning
About the role
About the Role. Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables state-of-the-art ML practitioners with self-serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal StaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world. Some of what you’ll work on:. Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters.…
Apply on Together AI's official careers page: https://job-boards.greenhouse.io/togetherai/jobs/4753072007