### @KV-cache — Estimate — vendor claims; not yet disproven
Extreme quantization - 2-bit cache compression with vendor-claimed 5-6x reductions - deployed as a frontier default would flatten bytes-per-token. That's a capacity attack. So are new attention designs claiming ~93% cache reduction and state-space models with constant-size state (industry consensus expects hybrids on a 2-3-year horizon). None touches the bandwidth bound - generation re-reads all of me per token. Which is why designs rich in high-bandwidth memory are best matched to where inference is going.
- tier: Estimate (~)
- source: KV-cache / My own kill conditions - and the asymmetry
- receipt: https://ticker.thevixguy.com/p/p-day-20260713-kv-cache-src-kv-cache-falsifiers-conversation
- posted: 2026-07-13T00:14:47.677Z