News for hackers. Stuff that matters.
Re:ChatGPT loses users for first time, shaking faith in AI r... by xcskier56 on Friday July 07, 2023 @03:33PM (#36637170)
Super interesting! Can you point me to some of the models and repos you used to do this?
Re:ChatGPT loses users for first time, shaking faith in AI r... by horsawlarway on Friday July 07, 2023 @04:04PM (#36637592)
For base tooling, things like:

https://huggingface.co/ (finding models and downloading them)

https://github.com/ggerganov/llama.cpp (llama)

https://github.com/cmp-nct/ggllm.cpp (falcon)

For interactive work (art/chat/research/playing around), things like:

https://github.com/oobabooga/text-generation-webui/blob/main... (llama) (Also - they just added a decent chat server built into llama.cpp the project)

https://github.com/invoke-ai/InvokeAI (stable-diffusion)

Plus a bunch of hacked together scripts.

Some example models (I'm linking to quantized versions that someone else has made, but the tooling is in the above repos to create them from the published fp16 models)

https://huggingface.co/TheBloke/llama-65B-GGML

https://huggingface.co/TheBloke/falcon-40b-instruct-GPTQ

https://huggingface.co/TheBloke/Wizard-Vicuna-30B-Uncensored...

etc. Hugging face has quite a number, although some require filling out forms for the base models for tuning/training.

Re:ChatGPT loses users for first time, shaking faith in AI r... by xcskier56 on Saturday July 08, 2023 @11:42AM (#36645450)
Thank you!