News for hackers. Stuff that matters.
Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by thanhhaimai on Sunday December 03, 2023 @11:36AM (#38508297)
Just curious, have you tried a more uncommon paragraph? Could it be the case that the model simply learned the poem due to it being in the training set?
Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by blendorgat on Sunday December 03, 2023 @12:20PM (#38508731)
That fragment isn't any poem I know of. Google shows one result for an exact search of the opening, which is this post.
Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by cokernel_hacker on Sunday December 03, 2023 @03:44PM (#38510583)
I found more of it in here: https://www.oranlooney.com/post/playfair/

However, I can't determine where this is originally from...

Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by waveBidder on Sunday December 03, 2023 @01:24PM (#38509410)
it's… from men in black iirc, so if it knows movie scripts, it'd know this.
Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by rahimnathwani on Sunday December 03, 2023 @12:13PM (#38508650)
Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by CSMastermind on Sunday December 03, 2023 @01:44PM (#38509573)
Seems easy enough to do a more rigorous test. Just find a large set of novel text, write a program to segment it by sentence as well as uppercasing and removing spaces/punctuation.

Then run it through the GPT-4 API and compare the output to the original.

Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by ALittleLight on Sunday December 03, 2023 @02:36PM (#38509997)
Here is the result of asking for word segmentation with the text of your comment and the text of this comment, minus the link.

https://chat.openai.com/share/b17ecc0b-570c-4e20-9556-23bfa1...