Re:Language models and linguistic theories beyond words
by anonyfox on Thursday November 16, 2023 @09:32AM
(#38289955)
> is achingly small
don't agree. the amount of written words we feed in, yes. but a tottler is a multimodal system including not only audio/images but actually video, plus other senses like touch or smell. This complex input 24/7 is a lot of data that happens, and some brain relations to classify the world in form before it can spell out a label (word) for it.
Even just looking at a simple word (like "apple"), the human already has a lot of contextual information about it, mostly how its presented and how the presenter frames it (like yummy, tasty fruit! like other foods in the fridge, ...), and then people say the word physically pointing at the thing.
My guess thats an order of magnitude more total input than our LLMs get solely via text or other standalone channels for training.
don't agree. the amount of written words we feed in, yes. but a tottler is a multimodal system including not only audio/images but actually video, plus other senses like touch or smell. This complex input 24/7 is a lot of data that happens, and some brain relations to classify the world in form before it can spell out a label (word) for it.
Even just looking at a simple word (like "apple"), the human already has a lot of contextual information about it, mostly how its presented and how the presenter frames it (like yummy, tasty fruit! like other foods in the fridge, ...), and then people say the word physically pointing at the thing.
My guess thats an order of magnitude more total input than our LLMs get solely via text or other standalone channels for training.