Re:Llamafile lets you distribute and run LLMs with a single ...
by derwiki on Wednesday November 29, 2023 @11:27PM
(#38469638)
On a Macbook Pro M2, I get
[ Parent
| on HN ]
Re:Llamafile lets you distribute and run LLMs with a single ...
by jart on Wednesday November 29, 2023 @11:38PM
(#38469710)
Could you disable SIP and run `lldb -- $TMPDIR/.ape-1.8 ./llamafile-server-0.1-llava-v1.5-7b-q4` and give me (1) the name of the instruction that's illegal (or its hex value) and (2) the hex address of where that instruction is in memory? You're encouraged to file a GitHub issue about this too. Thanks!
Re:Llamafile lets you distribute and run LLMs with a single ...
by derwiki on Friday December 01, 2023 @10:41AM
(#38488016)
Closing the loop for anyone reading this thread -- see https://github.com/Mozilla-Ocho/llamafile/issues/11 for the fix. Thanks jart!