Re:Tokens are a big reason today's generative AI falls short
by GaggiX on Saturday July 06, 2024 @05:23PM
(#40893433)
I mean, they are much better than humans at "mental" arithmetic.
[ Parent
| on HN ]
Re:Tokens are a big reason today's generative AI falls short
by soloist11 on Saturday July 06, 2024 @05:42PM
(#40893532)
I don't know what that means. There is nothing "mental" happening in the circuits of the computer or the function graph which is implemented on top of it.
Re:Tokens are a big reason today's generative AI falls short
by GaggiX on Saturday July 06, 2024 @05:47PM
(#40893570)
In the context of AI, it's a term that I borrow from human cognition to describe rapid calculations without external aids.
Re:Tokens are a big reason today's generative AI falls short
by soloist11 on Saturday July 06, 2024 @08:08PM
(#40894251)
The comparison still makes no sense. What would be an external aid for a computer?
Re:Tokens are a big reason today's generative AI falls short
by GaggiX on Saturday July 06, 2024 @09:49PM
(#40894682)
Well for the LLM would be a calculator.
Re:Tokens are a big reason today's generative AI falls short
by soloist11 on Saturday July 06, 2024 @11:03PM
(#40894977)
The LLM is a calculator. Think about it.
Re:Tokens are a big reason today's generative AI falls short
by fragmede on Saturday July 06, 2024 @11:30PM
(#40895070)
The LLM is an LLM. It runs on computer hardware which has an ALU, but that doesn't make the LLM a calculator. The LLM can, however, call out to a calculator to do addition when it deems necessary.
Re:Tokens are a big reason today's generative AI falls short
by soloist11 on Sunday July 07, 2024 @12:58AM
(#40895367)
The LLM is not doing anything other than arithmetic calculations. Every operation an LLM is doing can be done with a calculator.
Re:Tokens are a big reason today's generative AI falls short
by fragmede on Sunday July 07, 2024 @01:34AM
(#40895483)
Typically we don't refer to matrix multiplication as arithmetic calculations, but you do you.
Re:Tokens are a big reason today's generative AI falls short
by soloist11 on Sunday July 07, 2024 @01:40AM
(#40895506)
I'm pretty sure it's all arithmetic for an LLM but you do you too.
Re:Tokens are a big reason today's generative AI falls short
by Jensson on Sunday July 07, 2024 @04:52AM
(#40896143)
> Typically we don't refer to matrix multiplication as arithmetic calculations
You don't? Didn't you do them in school? Everyone calls that arithmetic's, you are just adding up and multiplying a bunch of numbers.
Re:Tokens are a big reason today's generative AI falls short
by fragmede on Monday July 08, 2024 @03:48AM
(#40903405)
do you really multiply numbers but call that arithmetic? I must sincerely ask, where are you?
Re:Tokens are a big reason today's generative AI falls short
by GaggiX on Sunday July 07, 2024 @12:39AM
(#40895311)
It's not.
Re:Tokens are a big reason today's generative AI falls short
by soloist11 on Sunday July 07, 2024 @12:58AM
(#40895369)
Are you sure?