Re:NanoGPT Slowrun: 10x Data Efficiency with Infinite Compute
by jack_pp on Thursday March 19, 2026 @10:43PM
(#47449812)
And that same information contained in an LLM is a compression of how many terabytes of training data? Maybe in the future there will be models an order of magnitude smaller and still better performing.
What I'm saying is you can't judge the data in the genome by purely counting the bytes of data.
What I'm saying is you can't judge the data in the genome by purely counting the bytes of data.