News for hackers. Stuff that matters.
Re:Books in .txt format for AI training purposes by nialv7 on Sunday October 25, 2020 @05:34PM (#24890098)
> with only a fraction of that information you can train a human to perform better than any GPT model shown thus far.

That's not a fair comparison. The human neural network is not trained _from scratch_. There is a very good fundamental structure we inherited through millions of years of evolution.

Re:Books in .txt format for AI training purposes by webmaven on Sunday October 25, 2020 @07:34PM (#24891165)
> The human neural network is not trained _from scratch_. There is a very good fundamental structure we inherited through millions of years of evolution.

It is worth noting that the training data used for training humans has been undergoing it's own optimization process for a while too (arguably for about 40ky, since the Upper Paleolithic Revolution, which is roughly when cultural evolution started taking over). In AI adjusting the training data is called Curriculum Learning. Right now most curriculum learning is done just by adjusting the order of training samples, rather than creating samples specifically optimized to facilitate learning (although GANs might be considered a Socratic approach to the latter, if you squint at it).

Re:Books in .txt format for AI training purposes by jononor on Sunday October 25, 2020 @07:50PM (#24891280)
Also, humans created all the text and the language and structures used within, for the purpose of communicating - so it is likely to be a good match for our cognitive systems.
Re:Books in .txt format for AI training purposes by bigbubba on Sunday October 25, 2020 @06:29PM (#24890623)
Yes, I conceded that we aren't blank slates. I still think we're on the wring track.