Re:Llamafile lets you distribute and run LLMs with a single ...
by mark_l_watson on Thursday November 30, 2023 @10:59AM
(#38475080)
Simon, does this also work well on Apple Silicon?
EDIT: never mind, other commenters here answered my question: yes it does work. I have a M2Pro with 32 G on chip memory - amazingly effective for experimenting with open LLMs.
EDIT: never mind, other commenters here answered my question: yes it does work. I have a M2Pro with 32 G on chip memory - amazingly effective for experimenting with open LLMs.