Tweet by kevin_flansburg
May 1, 2026
Yesterday Workers AI rolled out two major changes for Kimi k2.6: speculative decoding and shared KV cache. The first should improve TPS, especially for predictable output like tool calls. The second should improve cache hit rates, lowering TTFT and blended cost. https://t.co/Tl7LwhYpRm
- Author
- kevin_flansburg
- Date
- May 1, 2026
- Canonical URL
- /tweets/kevin-flansburg-2050238819065299110-41134a