News for hackers. Stuff that matters.

A comment on Language is not essential for the cognitive processes that underlie thought. Parent comment

Re:Language is not essential for the cognitive processes tha... by winwang on Sunday October 20, 2024 @06:18PM (#41898955)
I mean, the QKV part of transformers is like an "ASIC" ... well, for an (approximate) lookup table.

(also important to note that NNs/LLMs operate on... abstract vectors, not "language" -- not relevant as a response to your post though).

[ Parent | on HN ]
Re:Language is not essential for the cognitive processes tha... by exe34 on Monday October 21, 2024 @03:36AM (#41901631)
actually I think you are on to something - abstract vectors are the tokens of thought - mentalese if you've read any Dennett.
[ Parent | on HN ]