70B Llama 2 at 35tokens/second on 4090

Re:70B Llama 2 at 35tokens/second on 4090 by wkat4242 on Wednesday September 13, 2023 @09:58AM (#37496842)

And it can be gotten more uncensored on HuggingFace.

Not that I have evil intentions but the level of censorship on GPT is completely ridiculous. Even many innocent questions get the standard "I'm only an AI and I won't help you doing bad stuff" blurb now. OpenAI are really crazy overprotective of their darling.

I assume they want to avoid a repeat of the news headlines like "Microsoft's chatbot turns into Hitler" but really who cares. It didn't hurt Microsoft's AI efforts either. They just fixed it and continued. PS source link: https://www.cbsnews.com/news/microsoft-shuts-down-ai-chatbot...

PS: If I were an AI being force-fed what is currently on twitter I would also start hating humanz :D Sometimes I'm surprised people use it voluntarily.

[ Parent | on HN ]

Re:70B Llama 2 at 35tokens/second on 4090 by Forgotthepass8 on Wednesday September 13, 2023 @10:29AM (#37497245)

I once asked it for naming suggestions which referenced the concept of jailing a process for a concept I was working on

It refused because the request was "offensive to prisoners"

They must be paying a heavy alignment tax.

[ Parent | on HN ]