News for hackers. Stuff that matters.
Re:OpenChatKit – Fully open-source model, data and more by mach1ne on Saturday March 11, 2023 @02:46PM (#35111920)
How did this not get traction? I came upon the model from Twitter by chance. This is the first seemingly valid and functional open-source ChatGPT alternative. Can’t wait for the optimizations which will allow it (or similar) to run on consumer-grade GPUs.
Re:OpenChatKit – Fully open-source model, data and more by Retr0id on Monday March 13, 2023 @01:30PM (#35139191)
I'm also here wondering exactly the same thing!
Re:OpenChatKit – Fully open-source model, data and more by lxe on Tuesday March 14, 2023 @04:29AM (#35148700)
This works out of the box with oobabooga/text-generation-webui

    python .\download-model.py togethercomputer/GPT-NeoXT-Chat-Base-20B
    python server.py --load-in-8bit --int8-threshold 0 --listen --model GPT-NeoXT-Chat-Base-20B --cai-chat