Senior Software Engineer, Inference - AssemblyAI

Why AssemblyAI

AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2 billion+ end-user experiences. We are a lean, high-growth AI team where every engineer has outsized ownership and impact.

About the Role

We're hiring a Senior Software Engineer to help turn cutting-edge AI research into products our customers rely on every day. You'll sit on a fast-paced engineering team between our research org and our Applied teams, taking new model capabilities from proof of concept to robust, well-documented APIs serving production traffic at scale.

What You’ll Do

• Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration.
• Scale inference infrastructure to support our 1M+ API users.
• Partner with researchers to productionize new techniques, ensuring latency, reliability, and ergonomics match customer expectations.
• Collaborate with customers and Applied teams to feed user insights back into product design and research direction.
• Contribute across the stack as needed: backend services, inference infrastructure, SDKs, and internal tooling.

What You’ll Need

• Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production.
• Comfort operating with ambiguity, energized by bridging research and product timelines.
• Genuine curiosity about AI/ML and a desire to understand model mechanics to make sound engineering decisions.
• Strong collaboration skills to work effectively with researchers, applied engineers, and customers.