> IQ is compute speed, not storage.
Says who? Honestly. I've never seen that claim before. Sure, tests are timed but that's a proxy for efficiency in extrapolation.If we define IQ in this way then LLMs far outperform any human. I'm pretty confident this would be true of even more traditional LMs.
Speed really is just the measurement of recall. A doubt we'd call someone intelligent if they memorized the multiplication table up to 100x100. Maybe at first but when we ask them for 126*8358?
> Says who?
https://en.wikipedia.org/wiki/John_von_Neumann#Mathematical_...
Von Neumann's mathematical fluency, calculation speed, and general problem-solving ability were widely noted by his peers. Paul Halmos called his speed "awe-inspiring." Lothar Wolfgang Nordheim described him as the "fastest mind I ever met". Enrico Fermi told physicist Herbert L. Anderson: "You know, Herb, Johnny can do calculations in his head ten times as fast as I can! And I can do them ten times as fast as you can, Herb, so you can see how impressive Johnny is!" Edward Teller admitted that he "never could keep up with him", and Israel Halperin described trying to keep up as like riding a "tricycle chasing a racing car."
He had an unusual ability to solve novel problems quickly. George Pólya, whose lectures at ETH Zürich von Neumann attended as a student, said, "Johnny was the only student I was ever afraid of. If in the course of a lecture I stated an unsolved problem, the chances were he'd come to me at the end of the lecture with the complete solution scribbled on a slip of paper." When George Dantzig brought von Neumann an unsolved problem in linear programming "as I would to an ordinary mortal", on which there had been no published literature, he was astonished when von Neumann said "Oh, that!", before offhandedly giving a lecture of over an hour, explaining how to solve the problem using the hitherto unconceived theory of duality.
A story about von Neumann's encounter with the famous fly puzzle has entered mathematical folklore. In this puzzle, two bicycles begin 20 miles apart, and each travels toward the other at 10 miles per hour until they collide; meanwhile, a fly travels continuously back and forth between the bicycles at 15 miles per hour until it is squashed in the collision. The questioner asks how far the fly traveled in total; the "trick" for a quick answer is to realize that the fly's individual transits do not matter, only that it has been traveling at 15 miles per hour for one hour. As Eugene Wigner tells it, Max Born posed the riddle to von Neumann. The other scientists to whom he had posed it had laboriously computed the distance, so when von Neumann was immediately ready with the correct answer of 15 miles, Born observed that he must have guessed the trick. "What trick?" von Neumann replied. "All I did was sum the geometric series."
> Von Neumann's mathematical fluency, calculation speed, and general problem-solving ability were widely noted by his peers
I'm impressed by LeBron's basketball skills. I'm not sure what that has to do with IQ.Certainly von Neumann's quickness helped him solve problems faster, but I'm not sure what this has to do with the discussion at hand. The story of Polya is not dependent upon von Neumann's speed, but it certainly makes it more impressive. The quote says "unsolved problem." It would be impressive if a solution were handed back in any amount of time.
Consider calculating 1+1*1*1*1*1*1*1*1... (= 2). It doesn't matter how quickly someone attempts to multiply an infinite number of 1s they will never succeed because infinity is too large. They have to notice a shortcut that lets them skip doing all the calculations. That shows the difference between calculation speed and happening upon a superior strategy.
But people who can calculate very quickly will have a lot of opportunities to come up with a successful strategy because they can try more in what time they have.
Trying to then take this flawed approach and apply it to AI is ludicrous and completely jumping the shark to me. You want to take a flawed measure of human intelligence that we also dont understand fully, and apply it to a machine that we also dont really understand? Ok, then miss me when I laugh at that kind of talk, it is just so silly. This is a more general rant in this broader thread and not directed at anyone spefifically.
I think it's really eye opening into what we can do. The guy trains a year and wins the US competition, moving on to represent the US in a world competition. I think anyone would be impressed if you saw someone memorize a deck of cards in under 2 minutes. But maybe the most astonishing thing is that we are all capable of this but very few can.
I mean we all go on "autopilot" at times. Much more frequently in things we do frequently. That's kinda a state of high recall. Not much thinking needs to be done. A great example of this might be a speed cuber, someone who solves rubix cubes fast. Clearly they didn't start that fast.
Then, IQ can be derived by determining how quickly all participants can answer the questionnaire correctly, and ranking their speeds, and then normalizing the values so 100 is in the middle.
Turns out, scores will fall along a bell curve if you do that. You can call that phenomenon whatever, but most people call it IQ and hopefully I've explained well why that has nothing at all to do with static knowledge in this comment.