Re:We Found an Neuron in GPT-2
by fragmede on Thursday February 16, 2023 @05:16PM
(#34827283)
Does this hypothetical laptop have a GPU? StableDiffusion is in this realm of "stuff" and is runnable on consumer GPU systems. It's a bit of trouble to get set Yu p if you're not a python dev (and kinda still is if you are) but it's a pretty neat ML model to play around with.
[ Parent
| on HN ]
Re:We Found an Neuron in GPT-2
by RobotToaster on Thursday February 16, 2023 @06:09PM
(#34828014)
My 2 year old gaming laptop runs stablediffusion just fine. Only having a gtx 1660 ti 6gb it's a little at the limit of what will run it though.
For sure, and even training is very doable on consumer hardware these days. Techniques like Dreambooth and LoRA have dramatically lowered the compute cost of finetuning large models on specific concepts. A recent GPU can train Stable Diffusion models on a concept using LoRA in < 30 minutes.