Re:Ask HN: Did you encounter any leap year bugs today?
by wruza on Thursday February 29, 2024 @10:49PM
(#39558338)
It doesn’t even matter how many tokens there is, because LLMs are completely ignorant about how their input is structured. They don’t see letters or syllables cause they have no “eyes”. The closest analogy with a human is that vocal-ish concepts just emerge in their mind without any visual representation. They can only “recall” how many “e”s are there, but cannot look and count.
[ Parent
| on HN ]
Re:Ask HN: Did you encounter any leap year bugs today?
by brewtide on Thursday February 29, 2024 @11:24PM
(#39558521)
Pre-cogs, I knew it.
Re:Ask HN: Did you encounter any leap year bugs today?
by alickz on Friday March 01, 2024 @06:11AM
(#39560679)
>They can only “recall” how many “e”s are there, but cannot look and count.
Like a blind person?
Re:Ask HN: Did you encounter any leap year bugs today?
by wruza on Friday March 01, 2024 @07:28AM
(#39561122)
My initial analogy was already weak, so I guess there's no point in extending it. They key fact here is that tokens are inputs to what essentially is an overgrown matrix multiplication routine. Everything "AI" happens few levels of scientific abstractions higher, and is semantically disconnected from the "moving parts".