Performance Engineer, Inference Engine at Anthropic
- Company: Anthropic
- Location: San Francisco, CA | New York City, NY
- Employment type: Full-time
- Posted: 2026-09-09
- Technologies: Anthropic
About the role
About Anthropic . Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. . Performance Engineer, Inference Engine. About the Role. Anthropic's inference engine is the software between the accelerator kernels and the routing layer. It manages the entire token path in between: batching requests, laying the model out across chips, managing memory for weights and activations, coordinating every forward pass, and managing model state across requests. Built in-house, it runs on all of our accelerator platforms, serving Claude to millions of users and running our research workloads.…
Apply on Anthropic's official careers page: https://job-boards.greenhouse.io/anthropic/jobs/5418323008