News for hackers. Stuff that matters.
Re:Running large language models like ChatGPT on a single GPU by efreak on Tuesday February 21, 2023 @09:59PM (#34891080)
https://github.com/aqualxx/stable-horde-notebook

My only problem with stable horde is that their anti-cp measure involves checking the prompt for words like small, meaning I can't use a nsfw-capable model with certain prompts (holding a very small bag, etc). That, and seeing great things in the image rating and being unable to reproduce because it doesn't provide the prompt.

There are no comments on this comment yet.