Re:Using mmap to make LLaMA load faster
by patrakov on Wednesday April 05, 2023 @01:55PM
(#35458012)
Officially, only as deltas against LLaMa weights, and needing a complicated and resource-intensive conversion procedure. Unofficially, yes, a pre-converted llama.cpp compatible ggml file is available, but obviously I won't publish the link here to avoid violating the Y Combinator's terms of use.
[ Parent
| on HN ]
There are no comments on this comment yet.