News for hackers. Stuff that matters.
Re:Does current AI represent a dead end? by cynicalpeace on Friday December 27, 2024 @12:39PM (#42524205)
Do they know what a hot shower feels like?

They can describe it. But do they actually know? Have they experienced it?

This is my point. Nerds keep dismissing physicality and experience.

If your argument is a brain in a jar will be generally intelligent, I think that's pretty clearly wrong.

Re:Does current AI represent a dead end? by tomrod on Friday December 27, 2024 @04:03PM (#42526021)
The proof that 1+1=2 is nontrivial despite it being clear and obvious. It does not rely on physicality nor experience to prove.

There are areas of utility here. Things need not be able to do all actions to be useful.

Re:Does current AI represent a dead end? by momentoftop on Friday December 27, 2024 @04:30PM (#42526218)
There isn't a serious proof that 1+1=2, because it's near enough axiomatic. In the last 150 years or so, we've been trying to find very general logical systems in which we can encode "1", "2" and "+" and for which 1+1=2 is a theorem, and the derivations are sometimes non-trivial, but they are ultimately mere sanity checks that the logical system can capture basic arithmetic.
Re:Does current AI represent a dead end? by tomrod on Friday December 27, 2024 @08:22PM (#42527714)
If this is new, then you're one of today's luck 10,000![2] Serious logical foundations take a lot of time and exposition to start from fundamentals. Dismissing them as non-serious because GP's argument failed to consider them is misguided, IMHO.

[0] The classic reference: https://en.wikipedia.org/wiki/Principia_Mathematica -- over 1,000 pages, Betrand Russell

[1] https://cmartinez.web.wesleyan.edu/documents/FP.pdf -- a bit more modern, relying on other mathematics under the hood (like DRY reduces the base count), 11 pages

[2] https://xkcd.com/1053/

[3] Some reasonable review https://blog.plover.com/math/PM.html

Re:Does current AI represent a dead end? by whiskiss on Saturday December 28, 2024 @09:23AM (#42531228)
Am I the only one that always felt like that xkcd post came from a place of insane intellectual elitism?

I teach multiple things online and in person... language like that seems like a great to lose a student. I'd quit as a student, it's so condescending sounding. It's only lucky because you get to flex ur knowledge!(jk, pushing it I know lol but i can def see it being taken that way)

Keep in mind I know you're just having fun.

Re:Does current AI represent a dead end? by tomrod on Saturday December 28, 2024 @10:29AM (#42531717)
I can't be too condescending with the number of typos I have to edit :D

I actually really like the message for 1 in 10,000. As a social outsider for much of my life, it helped me to learn that the way people dismissed my questions about common (to them) topics was more about their empathy and less about me.

But, these sorts of things are difficult to communicate via text media, so we thus persist.

Re:Does current AI represent a dead end? by whiskiss on Sunday December 29, 2024 @12:05PM (#42541159)
Yeah I guess I've had only a few people be the other person that treated me right as the 1 - I feel ya on being an outsider having things dismissed. Does make sense. Another person gave me a good alternate view as well.

On a side note my couple of times I thought I was treating someone to some great knowledge they should already know I'm pretty sure I came across as condescending. Not bc they didn't know it - i always aim to be super polite - just being young, stupid, and bad at communicating, heh.

Re:Does current AI represent a dead end? by fragmede on Saturday December 28, 2024 @08:50PM (#42536711)
The key thing to focus on with XKCD 1053, is that the alternative before that comic was to make fun of the person who didn't know there's a proof for, eg 1 + 1 = 2. "Oh, you didn't know there's a proof for that? are you an idiot? who doesn't know the proof for 1 + 1 = 2 by Alfred North Whitehead and Bertrand Russell?", to which I think you could agree would put possible students off more by that than being told they're in luck today.
Re:Does current AI represent a dead end? by whiskiss on Sunday December 29, 2024 @11:59AM (#42541120)
Ah okay that's a good read. I'm just always on edge about my language and sometimes view the worst possible interpretation rather than what most would read. I'm not a negative person... just goes back to some "protecting myself" instincts I unfortunately had to develop. Thanks for that view.
Re:Does current AI represent a dead end? by momentoftop on Saturday December 28, 2024 @07:33PM (#42536248)
Yes, as I said: systems such as Russell's encoded "1", "2" and "+" in such a way that the theorem "1 + 1 = 2" is non-trivial to prove. This doesn't say anything about the difficulty of proving that 1 + 1 = 2, but merely the difficulty of proving it in a particular logical encoding. Poincare ridiculed the Principia on this point almost immediately.

And had Russell failed to prove that 1 + 1 = 2 in his system, it would not have cast one jot of doubt on the fact that 1 + 1 = 2. It would only have pointed to the inadequacy of the Principia.

Re:Does current AI represent a dead end? by cynicalpeace on Saturday December 28, 2024 @08:39PM (#42536642)
There's no way you get to 1+1=2 without experience. There would be no one to even make that statement.
Re:Does current AI represent a dead end? by tomrod on Sunday December 29, 2024 @10:17AM (#42540424)
See the work I posted in sibling comment in this chain.
Re:Does current AI represent a dead end? by cynicalpeace on Wednesday January 01, 2025 @08:13PM (#42570742)
The subject has been debated ad nauseam by everyone like Descartes, Hume, Kant, and so on. If there were no one around to state 1 + 1 = 2, there would be no such statement. Hence, it does rely on at least 1 person's experience. Yours in fact, since everyone else could be an illusion.
Re:Does current AI represent a dead end? by Dilettante_ on Friday December 27, 2024 @01:14PM (#42524520)
So are you saying people who have CIPA are less intelligent for never having experienced a hot shower? By that same logic, does its ability to experience more colors increase the intelligence of a mantis shrimp?

Perhaps your own internal definition of intelligence simply deviates significantly from the common, "median" definition.

Re:Does current AI represent a dead end? by cynicalpeace on Friday December 27, 2024 @01:30PM (#42524656)
It's the totality of experiences that make an individual. Most humans that I'm aware of have a greater totality of experiences that make them far smarter than any modern AI system.
Re:Does current AI represent a dead end? by skinner_ on Friday December 27, 2024 @02:07PM (#42525061)
Greater totality of experiences than having read the whole internet? Obviously they are very different kind of experiences, but a greater totality? I'm not so sure.

Here is what we know: The Pile web scrape is 800GB. 20 years of human experience at 1kB/sec is 600GB. Maybe 1kB/sec is bad estimate. Maybe sensory input is more valuable than written text. You can convince me. But next challenge, some 10^15 seconds of currently existing youtube video, that's 2 million years of audiovisual experience, or 10^9GB at the same 1kB/sec.

Re:Does current AI represent a dead end? by whiskiss on Saturday December 28, 2024 @09:10AM (#42531145)
I feel the jump from "reading the internet" to experience has a gap in reasoning. I'm not experienced in philosophy or* logic enough(no matter how much I read, heh) to articulate it, but seems to get at the person's idea of lacking street smarts, common sense. An adult with basic common sense could probably filter out false information quicker since I can get Claude to tell me false info regularly(I still like em, pretty entertaining) which has not only factual but contradictory flaws any person wouldn't make. Like recently I had two pieces of data, then when comparing them it was blatently incorrectly(they were very close, but claude said one was 8x bigger for... idk why.)

Another commenter also mentioned sensory input when talking about the brown rat. As someone who is constantly fascinated at the brains ability to reason/process stuff before I'm even conscious of it, I feel this Stat is Underrated. I'm taking in and monitoring like 15 sensations of touch at all time. Something entering my visual field coming towards me can be deflected in half a second all while still understanding the rest of my surroundings, and where it might be safe to deflect an object. The brain is constantly calculating depth perception and stereo location on every image and sound we hear - also with the ability to screen out the junk or alter our perception accurately(knowing the correct color of items regardless of diff in color temp).

I do concede that's a heck of a lot of video data. It does have similar issues to what I said(lacks touch, often no real stereo location, good greenscreen might convince an AI of something a person intuitively knows is impossible) but the scale alone certainly adds a lot. That could potentially make up for what I see as a hugely overlooked thing as far as stimulus. I am monitoring and adjusting like, hundreds of parameters a second subconsciously. Like everything in my visual field. I don't think it can be quantified accurately how many things we consciously and subconsciously process, but I have the feeling it's a staggering amount.

Re:Does current AI represent a dead end? by cynicalpeace on Saturday December 28, 2024 @08:38PM (#42536634)
The people that have have barely used the internet are often far better conversation (and often more useful in the economy) than people who are addicted to the internet.
Re:Does current AI represent a dead end? by HDThoreaun on Friday December 27, 2024 @12:46PM (#42524263)
See the responses section https://en.wikipedia.org/wiki/Knowledge_argument This idea certainly has been long considered but I personally reject it.
Re:Does current AI represent a dead end? by cynicalpeace on Friday December 27, 2024 @01:05PM (#42524441)
While interesting, this is a separate thought experiment with its own quirks. Sort of a strawman, since my argument is formulated differently and simply argues that AIs need to be more than brains in jars for them to be considered generally intelligent.

And that the only reason we think AIs can just be brains in jars is because many of the people developing them consider themselves as simply brains in jars.

Re:Does current AI represent a dead end? by HDThoreaun on Friday December 27, 2024 @01:09PM (#42524477)
Not really. The point of it is considering whether physical experience creates knowledge that is impossible to get otherwise. Thats the argument you are making no? If Mary learns nothing new when seeing red for the first time an AI would also learn nothing new when seeing red for the first time.

> Do they know what a hot shower feels like? They can describe it. But do they actually know? Have they experienced it

Is directly a knowledge argument

Re:Does current AI represent a dead end? by cynicalpeace on Friday December 27, 2024 @01:20PM (#42524575)
Mary in that thought experiment is not an LLM that has learned via text. She's acquired "all the physical information there is to obtain about what goes on when we see ripe tomatoes". This does not actually describe modern LLMs. It actually better describes a robot that has transcribed the location, temperature, and velocity of water drops from a hot shower to its memory. Again, this thought experiment has its own quirks.

Also, it is an argument against physicalism, which I have no interest in debating. While it's tangentially related, my point is not for/against physicalism.

My argument is about modern AI and it's ability to learn. If we put touch sensors, eyes, nose, a mechanism to collect physical data (legs) and even sex organs on an AI system, then it is more generally intelligent than before. It will have learned in a better fashion what a hot shower feels like and will be smarter for it.

Re:Does current AI represent a dead end? by HDThoreaun on Friday December 27, 2024 @04:55PM (#42526422)
> While it's tangentially related, my point is not for/against physicalism.

I really disagree. Your entire point is about physicalism. If physicalism is true than an AI does not necessarily learn in a better fashion what a hot shower feels like by being embodied. In a physicalist world it is conceivable to experience that synthetically.

Re:Does current AI represent a dead end? by cynicalpeace on Saturday December 28, 2024 @08:41PM (#42536655)
I love hearing someone else tell me I'm not saying what I'm saying.