Mooncake: A KVCache-Centric Disaggregated Architecture for LLM Serving Posted by zinccat on Saturday June 29, 2024 @01:30AM from the github.com dept. https://github.com/kvcache-ai/Mooncake ( no comments | 2 points | on HN )
There are no comments yet.