News for hackers. Stuff that matters.
Re:NanoGPT Slowrun: 10x Data Efficiency with Infinite Compute by jack_pp on Thursday March 19, 2026 @10:43PM (#47449812)
And that same information contained in an LLM is a compression of how many terabytes of training data? Maybe in the future there will be models an order of magnitude smaller and still better performing.

What I'm saying is you can't judge the data in the genome by purely counting the bytes of data.

There are no comments on this comment yet.