News for hackers. Stuff that matters.
Re:Show HN: a desktop app to discover, download, and run off... by dtagames on Wednesday May 24, 2023 @12:42PM (#36060669)
Looks very useful! Can't wait to try the Windows version. Thanks!
[ Parent | on HN ]
Re:Show HN: a desktop app to discover, download, and run off... by ybu on Wednesday May 24, 2023 @12:47PM (#36060754)
hopefully soon!
[ Parent | on HN ]
Re:Show HN: a desktop app to discover, download, and run off... by ybu on Saturday May 27, 2023 @09:53AM (#36094847)
Follow up: Windows release is out.
[ Parent | on HN ]
Re:Show HN: a desktop app to discover, download, and run off... by pearlsteinj on Wednesday May 24, 2023 @12:45PM (#36060723)
Wow, this makes running LLMs locally significantly more approachable. Very cool!
[ Parent | on HN ]
Re:Show HN: a desktop app to discover, download, and run off... by leeholim on Wednesday May 24, 2023 @08:00PM (#36065531)
Agreed!
[ Parent | on HN ]
Re:Show HN: a desktop app to discover, download, and run off... by asselinpaul on Wednesday May 24, 2023 @03:55PM (#36063147)
This is great! CPU only for now or can it leverage GPU for sped up inference?
[ Parent | on HN ]
Re:Show HN: a desktop app to discover, download, and run off... by ybu on Wednesday May 24, 2023 @03:58PM (#36063174)
Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
[ Parent | on HN ]