Re:Language models can explain neurons in language models
by creatonez on Wednesday May 10, 2023 @02:17AM
(#35884244)
Coming up with new language is rarely ever coming up with new concepts that didn't exist until the word. We come up with high-level abstractions because there already exists a material system to be described and modeled. Language that doesn't describe anything that doesn't already exist is more like babbling.
[ Parent
| on HN ]
Re:Language models can explain neurons in language models
by chrisco255 on Wednesday May 10, 2023 @02:53AM
(#35884455)
Not really, no. There are plenty of intangible abstractions that don't describe material systems. Take imaginary numbers, for example. Or the concept of infinity or even zero, neither of which exists in the physical world.
The reason why "naming things" is the other hard problem in computer science, after cache invalidation, is that the process of identifying, creating, and describing ideal abstractions is itself inherently difficult.