News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by carbocation on Thursday November 30, 2023 @12:37AM (#38470072)
For whatever it's worth, the SHA sum is correct. The killed message is uninformative, looks like what happens when I'm OOM (but I have 64GB RAM of which only 24 is used for anything at the moment).

    $ sha256sum < llamafile-server-0.1-llava-v1.5-7b-q4
    a138c5db9cff3b8905dd6e579c2ab6c098048526b53ae5ab433ff1d1edb9de24  -

    $ ./llamafile-server-0.1-llava-v1.5-7b-q4
    Killed: 9
Re:Llamafile lets you distribute and run LLMs with a single ... by carbocation on Thursday November 30, 2023 @01:54PM (#38477472)
Looks like this may be due to crowdstrike, which I also have installed on this machine: https://github.com/Mozilla-Ocho/llamafile/issues/14#issuecom...
Re:Llamafile lets you distribute and run LLMs with a single ... by raajg on Thursday November 30, 2023 @02:52PM (#38478230)
oh wow, I would have never imagined that 'that' would be preventing me from running llama + llava! Confirming that I have Crowdstrike running too.