You Sound Like a Bot

Re:You Sound Like a Bot by Der_Einzige on Friday February 16, 2024 @12:23PM (#39400040)

A whole article that ultimately boils down to "the majority of normies are using LLM systems with low temperature settings".

Literally just set the damn temperature higher and allow for sampling from deeper down in the distribution (so relax top_p, top_k or equiv parameters) and suddenly you get creativity, and also more unhinged behavior.

[ Parent | on HN ]

Re:You Sound Like a Bot by htrp on Friday February 16, 2024 @12:47PM (#39400413)

chatgpt doesn't expose temp settings which is what most ppl use

[ Parent | on HN ]

Re:You Sound Like a Bot by baobabKoodaa on Friday February 16, 2024 @01:29PM (#39401040)

Wait whaat? You mean most people don't run dockerized Mixtral-Dolphin-4B-88X instances on a Kubernetes deployment in a GPU farm they built in their cellar?

[ Parent | on HN ]

Re:You Sound Like a Bot by red-iron-pine on Friday February 16, 2024 @03:32PM (#39402574)

wait, you're telling me I could just run that in my basement?

[ Parent | on HN ]