Re:What Are Transformer Models and How Do They Work?
by reubenmorais on Saturday April 15, 2023 @07:17AM
(#35579553)
Efficiency and also redundancy. Brains and bodies have incredible tolerance to damage.
Re:What Are Transformer Models and How Do They Work?
by MichaelZuo on Saturday April 15, 2023 @10:55AM
(#35581167)
And also reproducibility in adverse conditions without too many defects.
My guess is most of that complexity is necessary for efficiency, not for basic function.
Biological systems are unimaginably efficient at almost everything they do. The information storage density of DNA is within 1-2 orders of magnitude of the upper limit imposed by physics, the brain performs tasks that you need GPU clusters to emulate while using only 20 Watts of energy, some catalytic enzymes are a million times better than a platinum catalyst, etc.