Re:Stability AI Launches the First of Its StableLM Suite of ...
by peterstjohn on Wednesday April 19, 2023 @06:46PM
(#35634265)
So just use their base model and fine-tune with a non-restrictive dataset (e.g. Databricks' Dolly 2.0 instructions)? You can get a decent LoRA fine-tune done in a day or so on consumer GPU hardware, I would imagine.
The point here is that you can use their bases in place of LLaMA and not have to jump through the hoops, so the fine-tuned models are really just there for a bit of flash…
Re:Stability AI Launches the First of Its StableLM Suite of ...
by jimsimmons on Wednesday April 19, 2023 @07:22PM
(#35634550)
Looks like you’re seeing the glass as half empty here. Not sure if arguing here was more time efficient than just running the eval on the other set of weights.
*I wish I understood these things well enough to not have to ask, but alas I’m just a basic engineer
Re:Stability AI Launches the First of Its StableLM Suite of ...
by Garcia98 on Wednesday April 19, 2023 @11:10PM
(#35635931)
I use a GPU server and runtime is not free unfortunately.
Re:Stability AI Launches the First of Its StableLM Suite of ...
by jimsimmons on Wednesday April 19, 2023 @11:53PM
(#35636181)
Ah no worries then. Thanks for your datapoint regardless
They also chose to toot their horn about how open-source their models are, even though for practical uses half of their released models are not more open source than a leaked copy of LLaMa.