News for hackers. Stuff that matters.
Re:Ollama is now available on Windows in preview by jart on Saturday February 17, 2024 @03:58PM (#39413491)
llamafile has amd gpu support. on windows, it only depends on the graphics driver, thanks to our tinyBLAS library.

https://github.com/Mozilla-Ocho/llamafile/releases/tag/0.6.2

By default it opens a browser tab with a chat gui. You can run it as a cli chatbot like ollama as follows:

https://justine.lol/oneliners/#chat

Re:Ollama is now available on Windows in preview by antman on Sunday February 18, 2024 @02:11PM (#39422072)
Which amd cpus are supported by tinyBLAS/llamafile?
Re:Ollama is now available on Windows in preview by lostmsu on Wednesday February 21, 2024 @07:02PM (#39461369)
This is about GPU