256K context with 72MiB of KV cache on the GPU Posted by GreenGames on Tuesday June 16, 2026 @11:31AM from the github.com dept. https://github.com/Luce-Org/lucebox-hub/tree/main/optimizations/kvflash ( no comments | 2 points | on HN )
There are no comments yet.