Re:Llama.cpp 30B runs with only 6GB of RAM now
by datadeft on Sunday April 02, 2023 @02:52AM
(#35407867)
I was thinking about the limitation by the mobile HW. Yeah GPU support would be nice.
[ Parent
| on HN ]
There are no comments on this comment yet.