Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by fnordpiglet on Tuesday March 28, 2023 @04:02PM
(#35346996)
It’s because they’re confused in thinking human intelligence isn’t learned stochastic expectation.
[ Parent
| on HN ]
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by gary_0 on Tuesday March 28, 2023 @04:21PM
(#35347257)
That's how the brain evolved, after all: take incoming input, process according to previous patterns, output a reaction to peripheral nervous system that will enhance survival. The evolutionary purpose of a cortex is to store a statistical model of an animal's environment based on past stimulus. Human intelligence is just a complicated permutation of these initial systemic parameters.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by fnordpiglet on Tuesday March 28, 2023 @05:06PM
(#35347835)
That’s why people have to take courses in reasoning and logic to be able to successfully apply it. It’s not like reasoning and logic are natural human skills. They’re learned through reinforcement learning by repeatedly exposing our brain to patterns again and again until we can train our stochastic expectation juice to not hallucinate an answer.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by gary_0 on Tuesday March 28, 2023 @05:30PM
(#35348188)
And it takes ~20 years to train a new brain so it can coherently answer questions about a wide variety of topics. Even worse, you can't even copy-paste it once you're done!
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by layer8 on Tuesday March 28, 2023 @05:38PM
(#35348276)
It arguably needs much less training data though.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by rbanffy on Tuesday March 28, 2023 @06:14PM
(#35348748)
What we shouldn't is anthropomorphise it too much. While LLMs can express themselves and interact with us in natural language, their minds are very different from ours - they never learned by having an embodied self, and they can't continuously learn and adapt the way we do - once the conversation is over, it's like it never existed unless it's captured for a future training cycle.
Right now, their ability to learn is severely limited. And, yet, they outcompete us quite easily in a lot of different tasks.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by gary_0 on Tuesday March 28, 2023 @06:28PM
(#35348897)
Agreed. There are a hundred different kinds of information processing that go into a human-like mind, and we've kinda-sorta built one piece. And there are a lot of pieces that it would neither be sane nor useful to build (eg. internalized emotions), so we might not see an AI with all the pieces for a very long time ("never" is probably too much to hope for).
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by rbanffy on Wednesday March 29, 2023 @04:27AM
(#35354209)
It's amusing that our first contact with a completely alien intelligence is with one of our own making.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by satvikpendem on Wednesday March 29, 2023 @01:03AM
(#35352854)
How? Organisms with brains process every second of their life, is that not training data on a level comparable with current AI models?
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by layer8 on Wednesday March 29, 2023 @02:05AM
(#35353248)
From a pure data amount point of view yes, but relatively little of that would seem to be relevant for our intellectual capacities. If GPT was a robot moving autonomously around in the world with full visual, auditory and tactile apparatus, it may be a bit different.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by satvikpendem on Wednesday March 29, 2023 @01:00PM
(#35360018)
Hm, not sure how most of that data would be irrelevant, could you clarify? I think all of that data as well as interacting with the environment creates the level of knowledge and intelligence we have today.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by kweingar on Tuesday March 28, 2023 @06:15PM
(#35348757)
This seems backward to me. Wouldn’t you be less impressed by ChatGPT if you thought that thought that human intelligence worked the same way as LLMs?
If humans have some special sauce different from the computer, then it’s crazy that ChatGPT can emulate human writing so well. If humans are also just statistical models, then of course you can throw a big training set at some GPUs and it’ll do the same thing. Why should we be surprised or impressed by idioms?
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by OJFord on Tuesday March 28, 2023 @07:57PM
(#35349904)
I suppose it depends on the extent to which you're impressed by the concept of LLMs, I can see it both ways.
To explain the other way to your thinking: human intelligence is the same; holy crap they cracked robotic 'human' intelligence, it works exactly the same way.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ...
by fnordpiglet on Tuesday March 28, 2023 @06:49PM
(#35349177)
Well, I don’t they work exactly like the human mind, because we are likely a more complex ensemble model. But a) it’s impressive because it’s reaching a goal of computing for generations and as a computer scientist I’m excited, b) it’s corpus of learnings is the amazing collection of everything that we built with the modern internet, so it’s breadth and depth is astounding. The act of creating what we have naturally is itself exciting though.