News for hackers. Stuff that matters.
Re:Gzip and KNN Outperforms Transformers on Text Classification by nextos on Thursday July 13, 2023 @10:43AM (#36709941)
Something important to note is that the authors use normalized compression distance (NCD). NCD is a way to approximate Kolmogorov complexity.

This is a pretty old idea, see [1,2]. Old but still very useful, like perceptrons.

[1] Li and Vitanyi. An Introduction to Kolmogorov Complexity and Its Applications.

[2] Clustering by compression. https://arxiv.org/pdf/cs/0312044

There are no comments on this comment yet.