Story · Philip Kiely (Baseten)
What's New in Inference Engineering (Philip Kiely (Baseten))
talk · Story page
Why a four-bit KV cache splits local and data-center inference
Appeared in
- Giving an agent the decoder's confidence never beat a plain deterministic gate
Sep 21, 2026 · quick links
Subscribe
Get the brief in your inbox
Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.
- Weekdays at 8:45am IST, one lead story and 6 to 9 items.
- Sundays, an argued synthesis rather than a recap.
- One click to leave, and quiet days say so in the subject line.