Re:The Unpredictable Abilities Emerging from Large AI Models
by shrikant on Friday March 17, 2023 @12:52PM
(#35199631)
When I was a bored and under-challenged student in the early days of university, one of my tests during a programming exam was to write a program that spit out the factorial of an input integer.
For shits and giggles, I just just wrote a series of `if...then` statements for 0 to 5, and only actually calculated the factorial for inputs >=6. I passed after the examiner just input 3 and 5 and was satisfied that the output was correct. Oops.
Re:The Unpredictable Abilities Emerging from Large AI Models
by WalterBright on Friday March 17, 2023 @01:02PM
(#35199802)
Doing a table lookup for common cases and computing for the less common ones is perfectly valid!
Re:The Unpredictable Abilities Emerging from Large AI Models
by Jeff_Brown on Friday March 17, 2023 @01:26PM
(#35200103)
And for some problems it's even efficient. Not factorial, though.
Re:The Unpredictable Abilities Emerging from Large AI Models
by Jeff_Brown on Friday March 17, 2023 @05:30PM
(#35203173)
Oh you're right, hive mind, it's efficient. Sorry.
Re:The Unpredictable Abilities Emerging from Large AI Models
by dxbydt on Friday March 17, 2023 @01:48PM
(#35200372)
Not 100% sure but I believe this is how we landed the lunar module on the moon the first time...tan/arctan/both were too hard to compute on the processors of those days so they discretized into half angles & stored the tangents in a lookup table.
Re:The Unpredictable Abilities Emerging from Large AI Models
by hgsgm on Friday March 17, 2023 @04:56PM
(#35202795)
That's how early calculators worked, and some fast math libraries today too.
Re:The Unpredictable Abilities Emerging from Large AI Models
by speed_spread on Friday March 17, 2023 @09:12PM
(#35205017)
The Pentium FDIV bug was due to a bad value in a lookup table.
Re:The Unpredictable Abilities Emerging from Large AI Models
by thaw13579 on Friday March 17, 2023 @02:00PM
(#35200544)
This is the way. Next, you could cache those values for >=6 when you compute them and also use the previously cached values for sub-problem solutions.
Re:The Unpredictable Abilities Emerging from Large AI Models
by timdiggerm on Friday March 17, 2023 @01:30PM
(#35200152)
Sorry, did it try to predict the output, or did it only predict the output based on what it has seen people say about similar code online?
Re:The Unpredictable Abilities Emerging from Large AI Models
by drdeca on Friday March 17, 2023 @03:40PM
(#35201836)
Is your objection to the use of the word "try"?
Re:The Unpredictable Abilities Emerging from Large AI Models
by hgsgm on Friday March 17, 2023 @07:14PM
(#35204132)
The difference is "did it study the code and inputs/outputs" vs "it studied comments about the code"
What would it do if the training data was only code? Only code+inputs+outputs? Only function signature+inputs/outputs? Only signature+comments?
Etc.
Re:The Unpredictable Abilities Emerging from Large AI Models
by roflyear on Friday March 17, 2023 @03:42PM
(#35201869)
The second one
Re:The Unpredictable Abilities Emerging from Large AI Models
by jmvoodoo on Friday March 17, 2023 @07:53PM
(#35204487)
I think its knowledge of python can only come from comments about code, since it can't execute the python or learn from trying code like a human would.
That doesn't change the fact that its predicting the output based on its knowledge of python though.
So, yes you're right, but at the same time it doesn't change anything IMO.
The LLM didn't run the code, it tried to predict the output based on its knowledge of python and primes.