Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop. Parent comment
Mentions 120b is runnable on 8GB VRAM too: "Note that even with just 8GB of VRAM, we can adjust the CPU layers so that we can run the large 120B model too"
There are no comments on this comment yet.
Mentions 120b is runnable on 8GB VRAM too: "Note that even with just 8GB of VRAM, we can adjust the CPU layers so that we can run the large 120B model too"