Story · Bohan Li (EliseAI)
Realtime Voice Agents with Frontier Intelligence (Bohan Li (EliseAI))
talk · Story page
Li runs two transcription engines at once, a fast one that emits immediately and a slower one that corrects it, discarding the correction if newer audio has already arrived. A prefix cache reuses audio for phrases an earlier turn said.
In plain words
- Bohan Li described ways to make automated phone conversations feel faster.
- A fast program turns speech into text, while a slower program can correct mistakes using more information.
- The system replays speech saved from earlier replies when the same opening words appear again.
- Callers can hear replies sooner, even when the artificial intelligence behind the conversation takes longer to work.
Appeared in
- A shell beats a typed tool catalog, and agents barely report their work
Sep 16, 2026 · in the sections
Subscribe
Get the brief in your inbox
Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.
- Weekdays at 8:45am IST, one lead story and 6 to 9 items.
- Sundays, an argued synthesis rather than a recap.
- One click to leave, and quiet days say so in the subject line.