News for hackers. Stuff that matters.
Re:Language models and linguistic theories beyond words by hyeonwho22 on Wednesday November 15, 2023 @05:13PM (#38283333)
There was a fun recent variant on this game using LLMs, asking GPT3 (3.5?) to encode text in a way that it will be able to decode the meaning. Some of the encodings are insane:

https://www.piratewires.com/p/compression-prompts-gpt-hidden...

Re:Language models and linguistic theories beyond words by jonahrd on Thursday November 16, 2023 @12:15AM (#38285992)
This is super interesting. Are there more examples I can see? The one in the article is a famous song which makes me wonder if it's really "decompressing" the data, or just being hunted towards a very common popular pattern of tokens.
Re:Language models and linguistic theories beyond words by og_kalu on Thursday November 16, 2023 @01:22AM (#38286324)