News for hackers. Stuff that matters.

A comment on Ask HN: Self-hosted/open-source ChatGPT alternative? Like Stable Diffusion. Parent comment

Re:Ask HN: Self-hosted/open-source ChatGPT alternative? Like... by tough on Monday December 12, 2022 @04:17PM (#33960423)
you can fine-tune in 8bits weights for use in collab or similarly more restrained environments https://github.com/huggingface/transformers/issues/14839 https://huggingface.co/hivemind/gpt-j-6B-8bit

by fine-tuning you should be able to attain niche-specific better results than default chatGPT theoretically, if you're lucky and thorough I guess

[ Parent | on HN ]
Re:Ask HN: Self-hosted/open-source ChatGPT alternative? Like... by jakearmitage on Tuesday December 13, 2022 @11:09AM (#33970754)
How do you fine-tune to a specific use-case, though? You train it again, with smaller weights?
[ Parent | on HN ]