News for hackers. Stuff that matters.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by fnordpiglet on Tuesday March 28, 2023 @05:06PM (#35347835)
That’s why people have to take courses in reasoning and logic to be able to successfully apply it. It’s not like reasoning and logic are natural human skills. They’re learned through reinforcement learning by repeatedly exposing our brain to patterns again and again until we can train our stochastic expectation juice to not hallucinate an answer.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by gary_0 on Tuesday March 28, 2023 @05:30PM (#35348188)
And it takes ~20 years to train a new brain so it can coherently answer questions about a wide variety of topics. Even worse, you can't even copy-paste it once you're done!
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by layer8 on Tuesday March 28, 2023 @05:38PM (#35348276)
It arguably needs much less training data though.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by rbanffy on Tuesday March 28, 2023 @06:14PM (#35348748)
What we shouldn't is anthropomorphise it too much. While LLMs can express themselves and interact with us in natural language, their minds are very different from ours - they never learned by having an embodied self, and they can't continuously learn and adapt the way we do - once the conversation is over, it's like it never existed unless it's captured for a future training cycle.

Right now, their ability to learn is severely limited. And, yet, they outcompete us quite easily in a lot of different tasks.

Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by gary_0 on Tuesday March 28, 2023 @06:28PM (#35348897)
Agreed. There are a hundred different kinds of information processing that go into a human-like mind, and we've kinda-sorta built one piece. And there are a lot of pieces that it would neither be sane nor useful to build (eg. internalized emotions), so we might not see an AI with all the pieces for a very long time ("never" is probably too much to hope for).
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by rbanffy on Wednesday March 29, 2023 @04:27AM (#35354209)
It's amusing that our first contact with a completely alien intelligence is with one of our own making.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by satvikpendem on Wednesday March 29, 2023 @01:03AM (#35352854)
How? Organisms with brains process every second of their life, is that not training data on a level comparable with current AI models?
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by layer8 on Wednesday March 29, 2023 @02:05AM (#35353248)
From a pure data amount point of view yes, but relatively little of that would seem to be relevant for our intellectual capacities. If GPT was a robot moving autonomously around in the world with full visual, auditory and tactile apparatus, it may be a bit different.
Re:Cerebras-GPT: A Family of Open, Compute-Efficient, Large ... by satvikpendem on Wednesday March 29, 2023 @01:00PM (#35360018)
Hm, not sure how most of that data would be irrelevant, could you clarify? I think all of that data as well as interacting with the environment creates the level of knowledge and intelligence we have today.