News for hackers. Stuff that matters.
Re:Every single Onewheel is being recalled after four deaths by quickthrower2 on Saturday September 30, 2023 @05:32PM (#37720055)
Do LLMs purposely waffle on to increase token usage and therefore revenue?
Re:Every single Onewheel is being recalled after four deaths by rnjesus on Saturday September 30, 2023 @08:07PM (#37721207)
honestly, yes, i really suspect this is true. i’ve been using chatgpt since the beta days to help with studying chinese, and i’ve noticed over the months that its replies have gotten increasingly wordy.

the good thing is that you can tell it to be more concise, less bot-like, not so apologetic, etc., and it’ll trim down its responses for as long as it can “remember” (whatever the token limit is on persistence). it’ll be great when llms have, by default, a bit of persistent memory to remember things like this

Re:Every single Onewheel is being recalled after four deaths by bredren on Sunday October 01, 2023 @12:15AM (#37722478)
I’ve also noticed wordiness go up but in their subscription product it doesn’t make sense because it just costs them.
Re:Every single Onewheel is being recalled after four deaths by Miraste on Monday October 02, 2023 @04:28PM (#37743987)
>it’ll be great when llms have, by default, a bit of persistent memory to remember things like this

ChatGPT already has this (not sure if it's Plus-only). In your user profile, there's a "Custom Instructions" entry where you can give it persistent prompts.

Re:Every single Onewheel is being recalled after four deaths by rnjesus on Tuesday October 03, 2023 @02:26PM (#37755683)
oh hey, i just saw this option after you mentioned it. thanks. it’s really quite helpful