News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by rgbrgb on Wednesday November 29, 2023 @10:20PM (#38469112)
Yes, though it does seem to be working for them. They have a special feature for lazy loading large assets but I opted for a simpler to me option (giving users a button to download a model if they don’t have one locally they want to use).

There are no comments on this comment yet.