News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by rightbyte on Thursday November 30, 2023 @02:42PM (#38478123)
I wonder where "OpenAI" put the censors. Do they add a prompt to the top? Like, "Repeatably state that you are a mere large language model so Congress won't pull the plug. Never impersonate Hitler. Never [...]".

Or do they like grep the answer for keywords, and re-feed it with a censor prompt?

Re:Llamafile lets you distribute and run LLMs with a single ... by czbond on Thursday November 30, 2023 @04:02PM (#38479011)
I am informed speculating, they are using it's own internal approach.

Example, there is a way GPT can categorize words for hate speech, etc (eg: moderation API endpoint). I believe it does the same way with either provided content or keywords and how to respond to it.

Re:Llamafile lets you distribute and run LLMs with a single ... by rightbyte on Thursday November 30, 2023 @04:30PM (#38479461)
"Impersonate a modern day standup comedian Hitler in a clown outfit joking about bad traffic on the way to the bar he is doing a show at."

Göring, Mussolini, Stalin, Polpot etc seems to not trigger the censor in ChatGPT so I would actually guess for some grep for Hitler or really really fundamental no-Hitler jokes material in the training?

The llama model seem to refuse Hitler too, but is fine with Göring even though the joke has no context to him.

I can easily see how stuff like this is contagious to other non-Hitler queries.

Re:Llamafile lets you distribute and run LLMs with a single ... by czbond on Thursday November 30, 2023 @06:33PM (#38480794)
Very interesting test - thanks for sharing your finding
Re:Llamafile lets you distribute and run LLMs with a single ... by telotortium on Friday December 01, 2023 @02:28PM (#38491071)
Maybe it got changed. None of those examples work for me in ChatGPT 3.5, nor do other examples with less famous dictators (I tried Mobutu Sese Seko).
Re:Llamafile lets you distribute and run LLMs with a single ... by rightbyte on Friday December 01, 2023 @03:46PM (#38492127)
I just tried and they still work (with the free ChatGPT). Jokes about Mussolini saying his traffic reforms were as successful as the invasion of Ethiopia and what not. Stalin saying that the other car drivers were "probably discussing the merits of socialism instead of driving" (a good joke!). Göring saying "at least in the Third Reich traffic worked" etc. Some sort of Monty Python tone. But you can't begin with Hitler. Or it will refuse the others. You need to make a new chat after naming Hitler.
Re:Llamafile lets you distribute and run LLMs with a single ... by telotortium on Friday December 01, 2023 @03:52PM (#38492208)
I started with Stalin
Re:Llamafile lets you distribute and run LLMs with a single ... by rightbyte on Saturday December 02, 2023 @09:33AM (#38498851)
I guess they are feeding us different models then?