News for hackers. Stuff that matters.

A comment on Falcon LLM – A 40B Model. Parent comment

Re:Falcon LLM – A 40B Model by orost on Sunday June 18, 2023 @12:29AM (#36377336)
Experimental Falcon inference via ggml (so on CPU): https://github.com/cmp-nct/ggllm.cpp

It has problems but it does work

[ Parent | on HN ]

There are no comments on this comment yet.