News for hackers. Stuff that matters.

A comment on Stability AI Launches the First of Its StableLM Suite of Language Models. Parent comment

Re:Stability AI Launches the First of Its StableLM Suite of ... by nlightcho on Wednesday April 19, 2023 @01:21PM (#35630784)
Make sure you are using the instruction tuned model. The base model will be difficult to prompt.

It works in 8-bit with about 12GB of VRAM usage. Here's sample code:

https://gist.github.com/AlexanderDzhoganov/a1d1ebdb018e2e573...

[ Parent | on HN ]

There are no comments on this comment yet.