News for hackers. Stuff that matters.
Re:24 Seriously Embarrassing Hours for AI by kbelder on Thursday January 19, 2023 @11:40AM (#34442267)
And far less data in total. Linguistic data is only a tiny fraction of what we humans are exposed to.
Re:24 Seriously Embarrassing Hours for AI by foldr on Thursday January 19, 2023 @11:47AM (#34442418)
I don't think we have good estimates of the total amount of data that factors into human learning. The total amount of raw sensory data we receive over a lifetime is large, for sure, but only a tiny fraction of that is relevant to learning. Just think about how much bigger ChatGPT's training corpus would be if it consisted of .WAV files of people speaking an equivalent amount of text.