News for hackers. Stuff that matters.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by K0balt on Thursday June 08, 2023 @03:08PM (#36247033)
I can’t help but wonder if there are “glitch tokens” for human minds, collectively or individually?
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Natsu on Thursday June 08, 2023 @03:33PM (#36247474)
* * *
Re:Weird GPT-4 behavior for the specific string “ davidjl” by adzm on Friday June 09, 2023 @12:41AM (#36253263)
Do you have any suggestions on where to find these?
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Natsu on Friday June 09, 2023 @04:11PM (#36263506)
For impossible colors go here:

https://www.thoughtco.com/impossible-colors-introduction-415...

For art, just compare any of these images to the pictures in the article:

https://duckduckgo.com/?q=psychadelic+art&iax=images&ia=imag...

Re:Weird GPT-4 behavior for the specific string “ davidjl” by godelski on Thursday June 08, 2023 @03:19PM (#36247202)
For hunams the msot iprmoetnt tihng is taht the frist and lsat ltteer be in the rghit pclae. The rset can be a mses and usaully you can raed it wouthit a porbelm.

It is a deffinert knid of hullunciaation but we hvae drffeenit bisaes tahn GPT-4.

Trehe are ptenly of otehr tpyes of gitlch tkoens for hamuns too. See opitacl iulloisns, or the fomuas peom The Cahos.

https://ncf.idallen.com/english.html

Re:Weird GPT-4 behavior for the specific string “ davidjl” by Sharlin on Friday June 09, 2023 @03:39AM (#36254593)
That's something of a myth. Or, rather, English happens to have so many short words that only a few permutations are possible if you fix the first and last letters. In something like German it would absolutely not work as well. And even in English, it becomes more difficult if you don't cherry-pick fairly simple permutations that preserve some important structure of the word, like "deffinert" or "porblem".

But on the other hand, yes, natural language has low entropy and lots of redundancy because it's meant to have error correction. From most sentences you can drop several words, not just scramble them, and the meaning can be inferred from the context.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by godelski on Saturday June 10, 2023 @08:46PM (#36276885)
It's not a myth, it is a hallucination that works in English. Which used because we're all speaking that language here. Like I said above, it is a different bias, but we have different biases than LLMs. Every language is going to have different biases. Some classes of heteronyms don't even exist in certain languages so a similar thing to The Chaos doesn't work as well there either. Maybe Chomsky would say there are more clear examples since he believes in a universal grammar but I'm also not a linguist. Just wanted an example. I wouldn't call this cherry picking as it both works in a few latin languages as well as strongly works in English. But even in English there is a bit of care you need, like double letters help to be stuck together. That's not cherry picking though as the example isn't such a unique thing that it invalidates the main thesis (what cherry picking is about).
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Sharlin on Sunday June 11, 2023 @09:53AM (#36281373)
It’s not a hallucination. It’s simply error correction, just like optical disks or ECC RAM are resistant to scrambled bits thanks to redundant, low-entropy coding – the fact that the bits are correlated.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by mike_hearn on Thursday June 08, 2023 @03:40PM (#36247604)
silk silk silk silk silk silk silk silk

What do cows drink?

Re:Weird GPT-4 behavior for the specific string “ davidjl” by deathanatos on Friday June 09, 2023 @12:29AM (#36253153)
I mean, baby cows…
Re:Weird GPT-4 behavior for the specific string “ davidjl” by mike_hearn on Sunday June 11, 2023 @07:25AM (#36280315)
cow

noun

1. a fully grown female animal of a domesticated breed of ox, kept to produce milk or beef. "a dairy cow"

(definition from Oxford Language)

But you're right, in practice people often use the word cow to mean calf.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by harimau777 on Thursday June 08, 2023 @03:12PM (#36247089)
Not human, but this seems sort of similar: https://en.wikipedia.org/wiki/Chicken_hypnotism
Re:Weird GPT-4 behavior for the specific string “ davidjl” by K0balt on Thursday June 15, 2023 @07:25AM (#36338919)
My thoughts exactly. We used to do this all the time when I was a kid at my grampas place. There was other tricks with other animals too, but I can’t remember exactly.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by grepLeigh on Thursday June 08, 2023 @03:15PM (#36247137)
Absolutely, see: https://xkcd.com/856/

This "glitch" is a short-circuit pathway from the input token to a result that makes statistical sense to the model's representation of the world, but very little sense to someone operating outside of that statistical model (you).

An internet meme fits that definition too: it's a short-circuit to some specific in-group context.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by Izkata on Friday June 09, 2023 @01:07AM (#36253466)
First thing to come to mind for me are "thought-terminating cliché"s.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by dan_mctree on Friday June 09, 2023 @06:19AM (#36255729)
Not as extreme, but garden path sentences sometimes give me a glitchy feeling in how they lure you into an parsing error that takes difficulty to overcome. For example:

The complex houses married and single soldiers and their families.