News for hackers. Stuff that matters.
Re:Drink Me: (Ab)Using a LLM to Compress Text by Legend2440 on Sunday May 05, 2024 @12:05PM (#40265865)
It doesn’t matter how your predictor works, whether it’s a scientific theory, a statistical model, or a magic oracle. You can always perfectly convert its predictions into compression using entropy coding. The conversion process is black-box.
Re:Drink Me: (Ab)Using a LLM to Compress Text by mjburgess on Monday May 06, 2024 @02:35AM (#40271799)
yes, and this is a very trivial notion of prediction.

Predictions of novel objects derivative from scientific theories arent quantitative data points.