200 Million Patient Interactions Later — Vivek Muppalla, Hippocratic AI
Aug 19, 2026 · 20:40
Vivek Muppalla, head of AI engineering at Hippocratic AI, argues clinically safe AI voice agents can end healthcare rationing, citing 200 million conversations and 60-plus health systems. He details Polaris, their architecture running 31 models per call—one central model plus 30 specialists for labs, medications, scheduling—in parallel after each checks if it needs to speak. Their decoder-only audio LLM adds context and domain knowledge for drug recognition; single-word answers get rescored because 'no' heard as 'now' is catastrophic. With 4-bit quantization, speculative decoding, and KV cache compression, latency savings are reinvested into intelligence. But at 10,000 calls a day, 99% accuracy means 100 wrong appointments, so they use 7,000 clinicians and 450 tests to catch a 1% failure rate.
