News for hackers. Stuff that matters.
Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by 2OEH8eoCRo0 on Wednesday January 25, 2023 @02:50PM (#34523242)
Does it just require a lot more training? Im talking about the boring stuff. Children play and their understanding of the physical world is reinforced. How would you add the physical world to the training? Because everything that I do in the physical world is "training" me and enforcing my expectations.

We keep avoiding the idea that robots require understanding of the world since it's a massive unsolved undertaking.

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by sjducb on Wednesday January 25, 2023 @03:47PM (#34523949)
A human trains on way less data then an AI.

Chat GPT has processed over 500GB of text files from books, about 44 billion words.

If you read a book a week you might hit 70 million words by age 18

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by 2OEH8eoCRo0 on Wednesday January 25, 2023 @03:58PM (#34524092)
I disagree.

Starting from birth, humans train continuously on streamed audio, visual, and other data from 5 senses. An inconceivable amount.

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by danenania on Wednesday January 25, 2023 @05:55PM (#34525320)
And prior to that was billions of years of training by evolution that got us to the point where we could 'fine tune' with our senses and brains. A little bit of data was involved in all that too.
Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by wizofaus on Wednesday January 25, 2023 @10:26PM (#34527364)
I'd argue that is the fundamental difference though - brains that were able to make good guesses about what was going on in the environment with very limited information are the ones whose owners reproduced successfully etc. And it's not unreasonable to note that the information available to the brains of our forebears is therefore in a rather indirect but still significant way "encoded" into our brains (at birth). Do LLMs have an element of that at all in their programming? Do they need more, and if so, how could it be best created?
Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by mcswell on Wednesday January 25, 2023 @10:12PM (#34527289)
You missed the point. ChatGPT trained on a gazillion words to "learn" a language. Children learn their language from a tiny fraction of that. Streamed visual, smell, touch etc. don't help learn the grammars of (spoken) languages.
Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by sdiupIGPWEfh on Thursday January 26, 2023 @07:27AM (#34530858)
That has me wondering now.

It's absolutely true that children learn (and even generate) language grammar from a ridiculously small number of samples compared to LLMs.

But could the availability of a world model, in the form of other sensory inputs, contribute to that capacity? Younger children who haven't fully mastered correct grammar are still able to communicate more sensibly than earlier LLMs, whereas the earlier LLMs tend toward more grammatically correct gibberish. What if the missing secret sauce to better LLM training is figuring out how to wire, say, image recognition into the training process?

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by sdiupIGPWEfh on Thursday January 26, 2023 @07:42AM (#34530969)
It amuses me that this would be not unlike teaching an LLM with picture books.
Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by hypertele-Xii on Thursday January 26, 2023 @07:50AM (#34531022)
> visual, smell, touch etc. don't help learn the grammars of (spoken) languages.

Of course they do! These are literally the things children learn to associate language with. "Ouch!" is what is said when you feel pain.

An ML model can learn to associate the word "ouch" with the words "pain" and "feel", but it doesn't actually know what pain is, because it doesn't feel.

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by mcswell on Thursday January 26, 2023 @09:48PM (#34541863)
No. First off, I said grammar, not word meaning.

Second, saying "Ouch" is not even language. My cat says something when I step on her paw. That doesn't mean she understands language, nor that she speaks some language.

Third, you're right about pain, but an ML model can associate the word "red" with the color, and "walk" with images of people walking, and "sailboat" with certain images or videos, and plenty of other concepts. If that was what learning a language was, then AIs would understand language in lots of areas, if not in the specific domain of pain. But they don't.

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by OzCrimson on Friday January 27, 2023 @02:13PM (#34550357)
Isn't it more complicated than that? "Ouch" can be a lot of things, and that's where a lot of problems crop up in the AI world.

If one of my friends insults another friend, I might say,"OUCH!" I'm not in pain but I might want to express that the insult was a bit much. If someone tries to insult me and it's weak, I could reply with a dry, sarcastic "ouch."

Combine that with facial expression and tone of voice and 'ouch' is highly contextual.

One problem with some of the tools used to take down offensive comments on social media platforms is that they don't get context.

Let's say that 'ouch' is highly offensive and you got into trouble for calling someone an "ouch." If I want to discuss the issue and agree that you were being offensive, I could get into trouble with the ML/AI tools for quoting you.

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by VMG on Thursday January 26, 2023 @07:51AM (#34531026)
You can run the numbers with HD video and audio with high words-per-minute and you'd probably still be orders of magnitude below the model sizes
Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by ASalazarMX on Thursday January 26, 2023 @01:19PM (#34536100)
Last Christmas one of my nephews was gifted a noisy baby toy. I don't know what are his goals and constraints, but he's still training with it. Must have learned a lot by now.
Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by Maursault on Thursday January 26, 2023 @04:47PM (#34539322)
> and other data from 5 senses.

It only makes your point stronger, but there are way more[1] than 5 human senses, not counting senses we don't have that, say, dolphins or other animals do. I can only name a few others, such as proprioception, direction, balance, and weight discrimination, but there are too many to keep track of them all.

[1] https://www.nytimes.com/1964/03/15/archives/we-have-more-tha...

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by nitwit005 on Wednesday January 25, 2023 @05:00PM (#34524745)
Imagine someone has the idea of strapping mannequins to their car in hopes the AI cars will get out of the way.

Sure, you could add that to the training the AI gets, but it's just one malicious idea. There's effectively an infinite set of those ideas, as people come up with novel ideas all the time.

Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by mlboss on Wednesday January 25, 2023 @05:53PM (#34525295)
Reinforcement learning should solve this problem. We need to give robots the ability to do experiments and learn from failure like children.
Re:US Marines Defeat DARPA Robot by Hiding Under a Cardboard... by majormajor on Wednesday January 25, 2023 @09:05PM (#34526869)
Need to make those robots as harmless as children when they do that learning too. ;)

"Whoops, that killed a few too many people, but now I've learned better!" - some machine-learning-using car, probably