Re:Using GPT-3 to pathfind in random graphs
by nl on Saturday September 24, 2022 @08:37AM
(#32961950)
> The process of training is more-or-less just "building a search index", and prediction is little more than "looking up examples in the search index and combining".
It's really not.
You are compressing the information in that dataset. That means the model has to learn characteristics of the information in the data that represent it. This is one of the reasons why some argue that compression is a form of intelligence[1]
It's a very different mechanism to a search index or database even if in some case it appears to work similarly.
It's really not.
You are compressing the information in that dataset. That means the model has to learn characteristics of the information in the data that represent it. This is one of the reasons why some argue that compression is a form of intelligence[1]
It's a very different mechanism to a search index or database even if in some case it appears to work similarly.
[1] http://www.hutter1.net/ai/