News for hackers. Stuff that matters.
Re:33TB of text data for a 1T-parameter model by lisper on Saturday April 15, 2023 @07:51PM (#35585842)
Yes, but that environmental conditioning did not involve training on the contents of the Kindle library. And the results of that training are encoded in under a gigabyte.

For the record, I'm not saying LLMs are not a huge step forward. They are. But they are not -- and cannot be -- the whole answer.

Re:33TB of text data for a 1T-parameter model by GaggiX on Saturday April 15, 2023 @09:04PM (#35586275)
I think the human brain is naturally predisposed to learn a language, an evolutionary bias.

That helps tremendously compared to a tabula rasa.