News for hackers. Stuff that matters.
Re:The Limits of GPT-3 and Similar Large Language Models by eternalban on Saturday January 07, 2023 @04:19PM (#34292934)
> our brains also remember words

Word sounds. I can not read without hearing the word. (Now I wonder about those born deaf.) Based on that subjective experience which I presume is rather universal among the hearing, tokenized phones and phonemes seem promising.

Re:The Limits of GPT-3 and Similar Large Language Models by worik on Saturday January 07, 2023 @04:27PM (#34293021)
I am not deaf.

I do not hear words as I read. (As I write I do)

Re:The Limits of GPT-3 and Similar Large Language Models by com2kid on Saturday January 07, 2023 @06:58PM (#34294439)
There are a variety of reading styles, some involve recognizing whole words at a time, others involve sounding out words.

I'm also a whole word reader, it is IMHO generally faster than needing to mentally hear words.

Re:The Limits of GPT-3 and Similar Large Language Models by eternalban on Saturday January 07, 2023 @07:45PM (#34294766)
I just tried that. Not sure I like the feeling, seems to rob of the pleasure of reading. But it -is- an interesting effect. Do you get pleasure from it?
Re:The Limits of GPT-3 and Similar Large Language Models by com2kid on Saturday January 07, 2023 @08:23PM (#34295003)
It is how I learned to read, early on I could read lots of words I had no idea how to pronounce.

Makes reading sci-fi with funky alien names much easier! :D

Re:The Limits of GPT-3 and Similar Large Language Models by simonh on Sunday January 08, 2023 @06:06AM (#34298081)
It’s dominant but not universal. My daughters and I do this but my wife doesn’t. She can’t even imagine what it’s like.
Re:The Limits of GPT-3 and Similar Large Language Models by hfbff on Sunday January 08, 2023 @06:35AM (#34298236)
I read without hearing the words. If I'm tired, however, sometimes I need to start reading out loud to keep concentrated.

Also, non phonetic writing systems will push you towards not hearing while reading. For example, when I read chinese there are plenty of characters (hanzi) whose pronunciation I don't know (was it hai? Pai?), but I remember the meaning just fine.

Even with English (I'm not a native speaker) sometimes I won't remember how to pronounce a certain word, but I'll read it just fine.

Re:The Limits of GPT-3 and Similar Large Language Models by eternalban on Sunday January 08, 2023 @08:53AM (#34299095)
> Also, non phonetic writing systems will push you towards not hearing while reading. For example, when I read chinese there are plenty of characters (hanzi) whose pronunciation I don't know (was it hai? Pai?), but I remember the meaning just fine.

Makes sense. I also tried an earlier suggestion to (effectively speed) read and that seems to send constant interrupts to the speech center -- which is how I am beginning to imagine how it works -- and it struggles to keep up and very soon becomes silent. atm still prefer my apparently pedestrian reading mode as it has a strong 'pleasure of reading' aspect that as of now I do not get when attempting whole word parsing.

How do you experience the pleasure of reading? For me, the reconstructed voice of the author and in general the (for the lack of a better word) musical aesthetics of the 'text' are significant.

Curious: What's your favorite piece of poetry?

Re:The Limits of GPT-3 and Similar Large Language Models by hfbff on Saturday January 14, 2023 @01:42AM (#34377878)
It's funny that you mention poetry. With poetry I do like to feel the sound of words.

I very much like Emily Dickinson, why? (What's your favorite piece of poetry?)