Staff Machine Learning Engineer, Voice AI at Together AI
- Company: Together AI
- Location: San Francisco
- Employment type: Full-time
- Posted: 2026-05-19
About the role
About the Role . Together AI is building the best inference infrastructure for voice applications. Our Voice AI platform powers production-grade, real-time voice agents and applications — serving speech-to-text and text-to-speech models with best-in-class latency and reliability. We're looking for a Staff ML Engineer to drive the model serving layer for voice workloads. You'll work hands-on with inference engines like TRT-LLM and SGLang to optimize how we serve models like Whisper, Parakeet, Orpheus, and Kokoro — pushing latency and throughput to the frontier. You'll profile GPU utilization, design batching strategies for streaming audio, and ensure new model architectures can go from research to production quickly. This is a foundational hire on a small, high-impact team.…
Apply on Together AI's official careers page: https://job-boards.greenhouse.io/togetherai/jobs/5140763007