News for hackers. Stuff that matters.

A comment on Show HN: Open-Source Load Balancer for Llama.cpp. Parent comment

Re:Show HN: Open-Source Load Balancer for Llama.cpp by kgeist on Sunday June 02, 2024 @05:14AM (#40552669)
Llama.cpp can run on CPU, on GPU, or in mixed mode (some layers run on CPU and some on GPU if you don't have enough VRAM).
[ Parent | on HN ]

There are no comments on this comment yet.