Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by layer8 on Tuesday March 28, 2023 @05:38PM
(#35348276)
It arguably needs much less training data though.
[ Parent
| on HN ]
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by rbanffy on Tuesday March 28, 2023 @06:14PM
(#35348748)
What we shouldn't is anthropomorphise it too much. While LLMs can express themselves and interact with us in natural language, their minds are very different from ours - they never learned by having an embodied self, and they can't continuously learn and adapt the way we do - once the conversation is over, it's like it never existed unless it's captured for a future training cycle.
Right now, their ability to learn is severely limited. And, yet, they outcompete us quite easily in a lot of different tasks.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by gary_0 on Tuesday March 28, 2023 @06:28PM
(#35348897)
Agreed. There are a hundred different kinds of information processing that go into a human-like mind, and we've kinda-sorta built one piece. And there are a lot of pieces that it would neither be sane nor useful to build (eg. internalized emotions), so we might not see an AI with all the pieces for a very long time ("never" is probably too much to hope for).
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by rbanffy on Wednesday March 29, 2023 @04:27AM
(#35354209)
It's amusing that our first contact with a completely alien intelligence is with one of our own making.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by satvikpendem on Wednesday March 29, 2023 @01:03AM
(#35352854)
How? Organisms with brains process every second of their life, is that not training data on a level comparable with current AI models?
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by layer8 on Wednesday March 29, 2023 @02:05AM
(#35353248)
From a pure data amount point of view yes, but relatively little of that would seem to be relevant for our intellectual capacities. If GPT was a robot moving autonomously around in the world with full visual, auditory and tactile apparatus, it may be a bit different.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by satvikpendem on Wednesday March 29, 2023 @01:00PM
(#35360018)
Hm, not sure how most of that data would be irrelevant, could you clarify? I think all of that data as well as interacting with the environment creates the level of knowledge and intelligence we have today.