Re:I disagree with Geoff Hinton regarding "glorified autocom...
by usrbinbash on Saturday November 18, 2023 @01:45PM
(#38322939)
> with LLMs where it is able to declare a novel function and then use it.
Novel as in "implements a new algorithm that has never seen in any form and is actually an improvement over existing methodology"?
Here is a little thought experiment: If all the training data in the set says that manned, powered flight is impossible, is a statistical prediction engine trained on that data capable of developing an airplane?
In other words, could a very powerful stochastic parrot do what the Wright Brothers did?
Novel as in "implements a new algorithm that has never seen in any form and is actually an improvement over existing methodology"?
Here is a little thought experiment: If all the training data in the set says that manned, powered flight is impossible, is a statistical prediction engine trained on that data capable of developing an airplane?
In other words, could a very powerful stochastic parrot do what the Wright Brothers did?
My best guess is that no, it cannot.