News for hackers. Stuff that matters.
Re:Tokens are a big reason today's generative AI falls short by GaggiX on Saturday July 06, 2024 @05:47PM (#40893570)
In the context of AI, it's a term that I borrow from human cognition to describe rapid calculations without external aids.
Re:Tokens are a big reason today's generative AI falls short by soloist11 on Saturday July 06, 2024 @08:08PM (#40894251)
The comparison still makes no sense. What would be an external aid for a computer?
Re:Tokens are a big reason today's generative AI falls short by GaggiX on Saturday July 06, 2024 @09:49PM (#40894682)
Well for the LLM would be a calculator.
Re:Tokens are a big reason today's generative AI falls short by soloist11 on Saturday July 06, 2024 @11:03PM (#40894977)
The LLM is a calculator. Think about it.
Re:Tokens are a big reason today's generative AI falls short by fragmede on Saturday July 06, 2024 @11:30PM (#40895070)
The LLM is an LLM. It runs on computer hardware which has an ALU, but that doesn't make the LLM a calculator. The LLM can, however, call out to a calculator to do addition when it deems necessary.
Re:Tokens are a big reason today's generative AI falls short by soloist11 on Sunday July 07, 2024 @12:58AM (#40895367)
The LLM is not doing anything other than arithmetic calculations. Every operation an LLM is doing can be done with a calculator.
Re:Tokens are a big reason today's generative AI falls short by fragmede on Sunday July 07, 2024 @01:34AM (#40895483)
Typically we don't refer to matrix multiplication as arithmetic calculations, but you do you.
Re:Tokens are a big reason today's generative AI falls short by soloist11 on Sunday July 07, 2024 @01:40AM (#40895506)
I'm pretty sure it's all arithmetic for an LLM but you do you too.
Re:Tokens are a big reason today's generative AI falls short by Jensson on Sunday July 07, 2024 @04:52AM (#40896143)
> Typically we don't refer to matrix multiplication as arithmetic calculations

You don't? Didn't you do them in school? Everyone calls that arithmetic's, you are just adding up and multiplying a bunch of numbers.

Re:Tokens are a big reason today's generative AI falls short by fragmede on Monday July 08, 2024 @03:48AM (#40903405)
do you really multiply numbers but call that arithmetic? I must sincerely ask, where are you?
Re:Tokens are a big reason today's generative AI falls short by GaggiX on Sunday July 07, 2024 @12:39AM (#40895311)
It's not.
Re:Tokens are a big reason today's generative AI falls short by soloist11 on Sunday July 07, 2024 @12:58AM (#40895369)
Are you sure?
Re:Tokens are a big reason today's generative AI falls short by GaggiX on Sunday July 07, 2024 @01:10AM (#40895400)
Yes
Re:Tokens are a big reason today's generative AI falls short by soloist11 on Sunday July 07, 2024 @01:40AM (#40895511)
So the LLM is not doing arithmetic?