News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by simonw on Wednesday November 29, 2023 @10:52PM (#38469369)
Each llamafile is a .zip, so if you want to extract the weights out of it you can extract the gguf file directly.

    unzip -l llamafile-server-0.1-llava-v1.5-7b-q4 | grep llava-v1
    Archive:  llamafile-server-0.1-llava-v1.5-7b-q4
    4081004224  11-15-2023 22:13   llava-v1.5-7b-Q4_K.gguf
    177415936  11-15-2023 22:13   llava-v1.5-7b-mmproj-Q4_0.gguf

There are no comments on this comment yet.