News for hackers. Stuff that matters.

A comment on llama-fs: A self-organizing file system with llama 3. Parent comment

Re:llama-fs: A self-organizing file system with llama 3 by pratik_kanthi on Sunday May 26, 2024 @04:53PM (#40485299)
an extension seems the most natural way to do this, but that would entail hosting a model which isn't cheap, will give it a go
[ Parent | on HN ]
Re:llama-fs: A self-organizing file system with llama 3 by IncreasePosts on Sunday May 26, 2024 @05:05PM (#40485387)
Can extensions connect to localhost? IE to a local ollama for example.
[ Parent | on HN ]
Re:llama-fs: A self-organizing file system with llama 3 by pratik_kanthi on Tuesday May 28, 2024 @07:50AM (#40499762)
Yes they can. But the ergonomics of that aren't great. Also ollama takes up a sigificant amount of memory. I'm trying this with a cheap model like phi-3 hosted on my server.
[ Parent | on HN ]