News for hackers. Stuff that matters.
Re:OpenChatKit – Fully open-source model, data and more by lxe on Tuesday March 14, 2023 @04:29AM (#35148700)
This works out of the box with oobabooga/text-generation-webui

    python .\download-model.py togethercomputer/GPT-NeoXT-Chat-Base-20B
    python server.py --load-in-8bit --int8-threshold 0 --listen --model GPT-NeoXT-Chat-Base-20B --cai-chat

There are no comments on this comment yet.