News for hackers. Stuff that matters.

A comment on Large language models are having their Stable Diffusion moment.

Re:Large language models are having their Stable Diffusion m... by patricktlo on Saturday March 11, 2023 @05:45PM (#35113577)
That's amazing, any chance of running it on my trusty GTX 1060 6gb, or that's not enough VRAM?
[ Parent | on HN ]
Re:Large language models are having their Stable Diffusion m... by yacine_ on Saturday March 11, 2023 @11:09PM (#35116565)
From my mental math, you can run 4bit quant 7B, but the quality for that might not be what you're looking for.
[ Parent | on HN ]