ConnectX-2
Re:Tencent Hunyuan-Large
on Sunday November 17, 2024 @04:11AM (#42162968)
>I only use the GPU for context processing.
If your GPU has enough VRAM to support it, you might benefit from https://github.com/kvcache-ai/ktransformers