News for hackers. Stuff that matters.
Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by cs702 on Friday January 06, 2023 @01:05PM (#34278478)
Marcus has been on HN many times before, always criticizing other people's work as "machines that manipulate data but aren't really intelligent, because they have no understanding of the world:" https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que... . For a good summary of the opposing viewpoint, which disagrees with Marcus, read "The Bitter Lesson" by Rich Sutton: http://incompleteideas.net/IncIdeas/BitterLesson.html

In many ways, what we're seeing is a rehash of the "symbolic" versus "connectionist" approaches to AI, with critics like Marcus on the "symbolic" camp ("we need more understanding!") and the engineers and scientists who build AI systems, like Sutton, on the "connectionist" camp ("we need more computation!").

There are also AI researchers seeking to bridge the two approaches. Here's a recent example that seems significant to me: https://news.ycombinator.com/item?id=34108047 . Maybe we will eventually find that the "symbolic" and "connectionist" approaches are actually not different, as people like Minsky contended?

Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by mountainriver on Friday January 06, 2023 @01:43PM (#34279005)
For all the screaming of the symbolic researchers we have yet to see much from their approaches. All the recent very impressive advances in AI have been connectionist approaches.

Also a lot of the things that symbolic researchers have been claiming connectionism can’t achieve turned out to be emergent properties of connectionist approaches

Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by cs702 on Friday January 06, 2023 @01:55PM (#34279158)
Yes, I agree! I mean, it sure seems as if critics from the "symbolic" camp keep moving the goal posts, doesn't it?

The "constant moving of goal posts" is one of the reasons why I think the two sides may converge: Engineers and scientists on the "connectionist" side could very well find ways to build AI systems that rely on "dumb" computation at massive scales to reason about symbols representing entities in the external world, simultaneously silencing and satisfying the critics -- who, as always and as ever, will say they were right all along.

Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by superposeur on Friday January 06, 2023 @02:09PM (#34279342)
I read the interview expecting exactly what you describe. Instead I found a nuanced and illuminating discussion —- at least for a non-expert such as myself. Marcus references the symbolic vs connectionist debate and (at least by his own description) seems to be what you call a “bridger” of long standing.

His objections seem concrete and well supported — not just repeating “but does it really understand” over and over. (Admittedly there is some of this.)

Edit - Thank you for the links.

Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by cs702 on Friday January 06, 2023 @02:15PM (#34279418)
My perception is that he's positioning himself to say he's been right all along, as I describe here to another commenter on this thread:

https://news.ycombinator.com/item?id=34279158

Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by thefaux on Friday January 06, 2023 @10:18PM (#34284785)
The connectionist approach is disturbing to me when taken to its logical extreme, which for me is essentially a variation of the paperclip maximizer only the target is "consume as many resources as necessary to build the best approximation of human like intelligence."
Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by cma on Saturday January 07, 2023 @09:40AM (#34288342)
> with critics like Marcus on the "symbolic" camp ("we need more understanding!") and engineers and scientists who build AI systems, like Sutton, on the "connectionist" camp ("we need more computation!").

> There are also AI researchers seeking to bridge the two approaches.

I don't know if he does it with his work in practice, but throughout the interview Marcus says he wants to bridge the approaches. I think he references a really old talk or article from himself calling for that too.

Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by cs702 on Saturday January 07, 2023 @02:26PM (#34291651)
My perception is that he's positioning himself to say he's been right all along, as I describe here to another commenter here:

https://news.ycombinator.com/item?id=34279158