Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Large language models are having their Stable Diffusion moment. Parent comment
I've had success running the 7B model on a 16GB M1 Mac Mini (purchased in 2020!). I didn't bother to try but pretty sure the 13B model works as well.
I suspect you could grab one of those for less than $1000 these days.
There are no comments on this comment yet.
I've had success running the 7B model on a 16GB M1 Mac Mini (purchased in 2020!). I didn't bother to try but pretty sure the 13B model works as well.
I suspect you could grab one of those for less than $1000 these days.