Re:GPU Embedding with GGML
by wizzard0 on Monday October 16, 2023 @08:18AM
(#37898776)
CPU is still the first-class option, but GGML also supports Metal, cuBLAS and clBLAST for hw acceleration
[ Parent
| on HN ]
Would be great to support more GPU, Metal is the only graphics we support atm with CPU as a fallback