News for hackers. Stuff that matters.
Re:Data Compression Drives the Internet. Here’s How It Works by retrac on Saturday June 10, 2023 @09:30AM (#36270301)
> it can give you some tools or perspective that apply elsewhere

Compression is right at the junction of computer science and information theory. It might be what joins them together. For example, if you have infinite space, any algorithm can be O(n), trivially fast, with a giant lookup table between inputs and outputs. In practice you want to find a smaller but reasonably fast equivalent program to represent the same mapping -- optimizing a program is lossless compression. In machine learning, model training takes a large one-dimensional array (such as a string with all the text on the Internet) and lifts it into a multidimensional space. Language models create output strings patterned like the input string, while storing less data than the complete input string -- machine learning is a type of lossy compression.

There are no comments on this comment yet.