That’s a very misleading take, this is lossless audio and the majority of the bits are spent encoding noise. You can encode way more audio at perceptually but not technically lossless level in that space.
Or awful lot of text information (state of art compressors can do up to 1:10 ratio for plain text, decoder itself is rather small, 750MB compressed could potentially contain like 7GB of text data).
Also, look at demoscene. 4k (4 kB is the size of executable) can do crazy things, and 64kB can fit a lot of nice 3D objects, music, text, complex effects etc. weight less than any screenshot of any moment of running demo. In 95kB you can have full game (google kkringer)
Yet at the same time the result of this random code is extremely compressed, to the point we compare it to procedural generative code.
Not sure what we can do with this but it certainly seems like we can once again get inspired by nature on this one.
To expand upon your compression idea, the index it is using exists outside the DNA encoding itself which means it could be holding an absolute ton of data.
Bonus: https://xkcd.com/3056/
I am fond of the analogy of DNA to procedural generation. The "operating system", as I see it, is physics. Everything else is primitives built on top of that.
Our brains can't begin to comprehend the untold multitudes of interactions occurring at a molecular scale over geologic time.
There are limits to how Kolmogorov complexity scales up. Many of these tricks are exploiting procedural techniques that can be expressed in minimal terms. Once you start feeding in actual information that is not feasible to express procedurally (i.e., is already compressed/high-entropy), you are forced to accumulate bits. An obvious example of this would be incorporating a texture that is multiple megabytes when compressed as a jpeg on disk.
> An obvious example of this would be incorporating a texture
Some random range of storage data is now the texture. It was used to process formatting logic but now also a texture
What an insanely bad take.
Not only did you not read and/or comprehend the article, the article itself undersells the information content of the genome (I'll post on this at the top level).
> You are not predisposed to be anything.
This does not logically follow your preceding statement, even if we were to accept the foregoing limited information content as factual
What you can learn will just swamp any predispositions you have.
I think a more apt comparison would be that of a LLM of that size. qwen:0.5b is about 400MB, its abilities are laughable compared to the likes of ChatGPT, but it can write coherently about general topics. For instance.
>>> why would people be altruistic
People are likely to be altruistic because they believe that helping others is better for everyone involved.
People may also believe in the power of compassion and empathy towards others, which can contribute to greater altruism.
Overall, people are likely to be altruistic because they believe that helping others is better for everyone involved.
It is not a statement about LLMs, more about what you can achieve with "just" 400MB for storage. The other similarity is that LLMs are also "messy", if you want to see the results of finely crafted work in a really small amount of space, look at what sizecoders can do with a few kB of code or less.1. You can dramatically increase the amount of information stored by compression. Uh, no. Information content is measured, as it were, "post-compression". There is a limit to how much information you can store in a gigabyte, and that limit is--a gigabyte.
2. Information content is not just stored in the DNA, but also in all of the ancillary proteins, etc. Well, the the information on how to create the proteins themselves are stored in DNA. Any additional information, then, has to be contributed by the environment. But that is exactly my point--environment matters way more than the information stored in the DNA.
3. "you are wrong", "you are a mathematical ignoramus" etc etc is ad hom. It is not a valid argument, contributes nothing to the conversation, and is not a good look. If you disagree let's see some math.
4. No matter how much information you think is stored in DNA, the amount of information stored in your brain is at least 5 orders of magnitude larger. The information you can learn swamps out any predispositions you might have. Go become the kind of person you want to be.
This rules out pretty much every nutty theory which evolutionary psychologists propose. Such as we evolved for altruism, we evolved to believe in religion, etc etc. Complete B.S. Exactly how much information would you need to specify a behavior like being predisposed to a belief in religion??? There's less than 80 minutes worth of music's worth of information in our genomes, and most of that is concerned with just keeping us alive.
You are not predisposed to be anything. Go create the kind of person you want to be.