Tweet by kevin_flansburg
May 21, 2026
Landed changes to SGLang to address two use-after-free bugs in decode side KV cache. This was causing garbled output with Kimi K2.6 under heavy concurrency when using decode KV cache offload. https://t.co/bY6b7L6WfC
- Author
- kevin_flansburg
- Date
- May 21, 2026
- Canonical URL
- /tweets/kevin-flansburg-2057531497624821994-ac578a