Re:Forget ChatGPT: why researchers now run small AIs on thei...
by threecheese on Saturday September 21, 2024 @04:34PM
(#41612514)
Any tips you can give for like minded folks? Besides grimjim (checking it out).
Re:Forget ChatGPT: why researchers now run small AIs on thei...
by wkat4242 on Saturday September 21, 2024 @09:58PM
(#41614085)
Well you can use some jailbreak prompts but with cloud models it's a cat and mouse game as they constantly fix known jailbreaks. With local models this isn't a problem of course. But I prefer getting a fine-tune model so I don't have to cascade prompts.
Not all uncensored models are great. Some return very sparse data or don't return the end tags sometimes so they keep hallucinating and never finish.
If you import grimjim's model, make sure you use the complete modelfile from vanilla lama3.1, not just an empty modelfile. Because he doesn't provide one. This really helps setting the correct parameters so the above doesn't happen so much.
But I have seen it happen with some official ollama models like wizard-vicuna and dolphin-llama. They come with modelfiles so they should be correct.
Re:Forget ChatGPT: why researchers now run small AIs on thei...
by wkat4242 on Saturday September 21, 2024 @04:40PM
(#41612545)
@the_gorilla: I don't consider bdsm to be 'degenerate' nor violent, it's all incredibly consensual and careful.
It's just that the LLMs trigger immediately on minor words and shut down completely.
The biggest benefits for me are the uncensored models. I'm pretty kinky so the regular models tend to shut me out way too much, they all enforce this prudish victorian mentality that seems to be prevalent in the US but not where I live. Censored models are just unusable to me which includes all the hosted models. It's just so annoying. And of course the privacy.
It should really be possible for the user to decide what kind of restrictions they want, not the vendor. I understand they don't want to offer violent stuff but 18+ topics should be squarely up to me.
Lately I've been using grimjim's uncensored llama3.1 which works pretty well.