Ask HN: Self-hosted/open-source ChatGPT alternative? Like Stable Diffusion

Re:Ask HN: Self-hosted/open-source ChatGPT alternative? Like... by theCrowing on Monday December 12, 2022 @01:59PM (#33958652)

The best options are probably GPT-J and BLOOM but they are both so big they need at least a 24GB of VRAM and they are not as suffisticated.

[ Parent | on HN ]

Re:Ask HN: Self-hosted/open-source ChatGPT alternative? Like... by tough on Monday December 12, 2022 @04:17PM (#33960423)

you can fine-tune in 8bits weights for use in collab or similarly more restrained environments https://github.com/huggingface/transformers/issues/14839 https://huggingface.co/hivemind/gpt-j-6B-8bit

by fine-tuning you should be able to attain niche-specific better results than default chatGPT theoretically, if you're lucky and thorough I guess

[ Parent | on HN ]

Re:Ask HN: Self-hosted/open-source ChatGPT alternative? Like... by jakearmitage on Tuesday December 13, 2022 @11:09AM (#33970754)

How do you fine-tune to a specific use-case, though? You train it again, with smaller weights?

[ Parent | on HN ]

Re:Ask HN: Self-hosted/open-source ChatGPT alternative? Like... by musicale on Monday December 12, 2022 @03:48PM (#33960059)

> not as suffisticated

ChatGPT in a nutshell.

(I hadn't heard the slang before, but it seems descriptive for a false air of sophistication, or [possibly over-]sophisticated complexity that nevertheless leads to bad results.)

[ Parent | on HN ]