GPU Embedding with GGML

Re:GPU Embedding with GGML by telegpt on Monday October 16, 2023 @07:57AM (#37898534)

Run Code Llama 13B GGUF Model on CPU: GGUF is the new GGML https://cliprecaps.com/read/?v=rZz5AORu8zE

[ Parent | on HN ]

Re:GPU Embedding with GGML by wizzard0 on Monday October 16, 2023 @08:15AM (#37898756)

GGML is the library, GGUF is the new GGML model format.

[ Parent | on HN ]

Re:GPU Embedding with GGML by telegpt on Monday October 16, 2023 @08:40AM (#37899026)

nice

[ Parent | on HN ]

Re:GPU Embedding with GGML by louiskw on Monday October 16, 2023 @01:58PM (#37903634)

This is correct, GGML the library isn't going anywhere

[ Parent | on HN ]

Re:GPU Embedding with GGML by kordlessagain on Monday October 16, 2023 @03:10PM (#37904698)

This article is about embeddings, so are you indicating this can be done from Code Llama 13B?

[ Parent | on HN ]