Re:OpenChatKit – Fully open-source model, data and more
by mach1ne on Saturday March 11, 2023 @02:46PM
(#35111920)
How did this not get traction? I came upon the model from Twitter by chance. This is the first seemingly valid and functional open-source ChatGPT alternative. Can’t wait for the optimizations which will allow it (or similar) to run on consumer-grade GPUs.
[ Parent
| on HN ]
Re:OpenChatKit – Fully open-source model, data and more
by Retr0id on Monday March 13, 2023 @01:30PM
(#35139191)
I'm also here wondering exactly the same thing!
Re:OpenChatKit – Fully open-source model, data and more
by lxe on Tuesday March 14, 2023 @04:29AM
(#35148700)
This works out of the box with oobabooga/text-generation-webui
python .\download-model.py togethercomputer/GPT-NeoXT-Chat-Base-20B
python server.py --load-in-8bit --int8-threshold 0 --listen --model GPT-NeoXT-Chat-Base-20B --cai-chat