News for hackers. Stuff that matters.
Re:Gödel's theorem debunks the most important AI myth – Roge... by xpe on Sunday March 02, 2025 @06:36PM (#43236492)
> But the inferences of the resulting neural nets is not an algorithm.

Incorrect.

The comment above confuses some concepts.

Perhaps this will help: consider a PRNG implemented in software. It is an algorithm. The question of the utility of a PRNG (or any algorithm) is a separate thing.

Re:Gödel's theorem debunks the most important AI myth – Roge... by bwoj on Sunday March 02, 2025 @06:59PM (#43236680)
On one level, yes you’re right. Computing weights and propagating values through an ANN is well defined and very algorithmic.

On the level where the learning is done and knowledge is represented in these networks there is no evidence anyone really understands how it works.

I suspect maybe at that level you can think of it as an algorithm with unreliable outputs. I don’t know what that idea gains over thinking it’s not algorithmic and just a heuristic approximation.

Re:Gödel's theorem debunks the most important AI myth – Roge... by dTal on Sunday March 02, 2025 @07:32PM (#43236939)
"Heuristic" and "algorithmic" are not antipodes. A heuristic is a category of algorithm, specifically one that returns an approximate or probabilistic result. An example of a widely recognized algorithm that is also a heuristic is the Miller-Rabin primality test.

https://xlinux.nist.gov/dads/HTML/heuristic.html

https://xlinux.nist.gov/dads/HTML/millerRabin.html

https://en.wikipedia.org/wiki/Miller%E2%80%93Rabin_primality...

Re:Gödel's theorem debunks the most important AI myth – Roge... by seanhunter on Monday March 03, 2025 @01:04AM (#43238780)
“Algorithm” just means something which follows a series of steps (like a recipe). It absolutely does not require understanding and doesn’t require determinism or reliable outputs. I am sympathetic to the distinction that (I think) you’re trying to make but ANNs and inference are most certainly algorithms.
Re:Gödel's theorem debunks the most important AI myth – Roge... by xpe on Monday March 03, 2025 @05:59AM (#43240542)
> On the level where the learning is done and knowledge is represented in these networks there is no evidence anyone really understands how it works.

It is hard to assess the comment above. Depending on what you mean, it is incorrect, inaccurate, and/or poorly framed.

The word “really” is a weasel word. It suggests there is some sort of threshold of understanding, but the threshold is not explained and is probably arbitrary. The problem with these kinds of statements is that they are very hard to pin down. They use a rhetorical technique that allows a person to move the goal posts repeatedly.

This line of discussion is well covered by critics of the word “emergence”.

Re:Gödel's theorem debunks the most important AI myth – Roge... by ccvannorman on Sunday March 02, 2025 @09:26PM (#43237654)
This.

Heuristic or not, AI is still ultimately an algorithm (as another comment pointed out, heuristics are a subset of algorithms). AI cannot, to expand on your PRNG example, generate true random numbers; an example that, in my view, betrays the fundamental inability of an AI to "transcend" its underlying structure of pure algorithm.

Re:Gödel's theorem debunks the most important AI myth – Roge... by xpe on Monday March 03, 2025 @08:13AM (#43241398)
1. If an outside-the-system observer cannot detect any flaws in a RNG, does the outsider have any basis for claiming a lack of randomness? I’m driving home a key point: practically speaking, randomness is a matter of perspective.

2. AI just means “non human” intelligence. An AI system (of course) can incorporate “real world” sources of entropy such as sensors. This is already done.