News for hackers. Stuff that matters.
Re:LibraryBox by cush on Tuesday March 05, 2024 @12:54PM (#39606898)
A future version of an ebook library would be an offline large language model? So like, instead of downloading Moby Dick, you can ask for it to be generated?
Re:LibraryBox by n8fr8too on Tuesday March 05, 2024 @01:54PM (#39607727)
There is definitely interest in providing off-grid communities easy access to lightweight LLMs... one idea is to use something like: https://github.com/mlc-ai/web-llm to deliver it in a browser
Re:LibraryBox by cush on Tuesday March 05, 2024 @02:38PM (#39608245)
Oh I see. Was confused. The “this” in OP’s comment is an offline library. An offline LLM would be nice too.
Re:LibraryBox by qgin on Wednesday March 06, 2024 @11:31AM (#39617631)
Yeah, to clarify, I didn't mean it would be a direct replacement for literature, just that on the same theme of of providing a resource in places where connectivity is an issue, an LLM is a reasonable way to compress a whole lot of human knowledge into a relatively small space in a usable form.