Exactly. Fixing the old tells just means there are new ones.
Re:ChatGPT Pro
by handfuloflight on Thursday December 05, 2024 @09:42PM
(#42335689)
> Maybe a database could be built with “tells” organized by model.
Automated by the LLMs themselves.
No thanks, I’d like it to be accurate ;)
Regular ol tests would do
Re:ChatGPT Pro
by handfuloflight on Friday December 06, 2024 @04:59PM
(#42344981)
I should have been more precise. I meant the LLMs would output their tells for you, naturally. But that's obvious.
They can’t know their own tells… that’s not how any of this works.
Thinking about it a bit more, the tells that work might depend on the usage of other specific prompts.
Re:ChatGPT Pro
by handfuloflight on Saturday December 07, 2024 @02:13PM
(#42352054)
Not sure why you default to an uncharitable mode in understanding what I am trying to say.
I didn't say they know their own tells. I said they naturally output them for you. Maybe the obvious is so obvious I don't need to comment on it. Meaning this whole "tells analysis" would necessarily rely on synthetic data sets.
Maybe a database could be built with “tells” organized by model.