News for hackers. Stuff that matters.
Re:We Don't Know How to Compute (2011) [video] by lostmsu on Monday May 15, 2023 @09:31AM (#35947846)
> A driver can respond to a visual stimulus in a few hundred milliseconds, and decide an action, such as making a turn. So the computational depth of this behavior is only a few tens of steps. We don't know how to make such a machine, and we wouldn't know how to program it.

IMHO, that makes no sense. Assuming we have a really large state machine with all many possible situations in a state of driving on a straight highway with a few vehicles with more or less constant relative velocity, determining if we need to make a turn is definitely doable in a few computation steps.

Re:We Don't Know How to Compute (2011) [video] by leroy-is-here on Monday May 15, 2023 @09:41AM (#35948005)
We attempted the symbolic route of AI programming and it didn’t work because it is explosive in computation time and exhaustive to model in code.

We can’t program our AI “models” now because they are based on chains of probabilities. Therefore they can run in real time. They don’t have any real logic that we specifically programmed, only what the model was able to infer and then encode.

Perhaps there should be a marriage between these two attempts of AI.

Re:We Don't Know How to Compute (2011) [video] by marcosdumay on Monday May 15, 2023 @10:50AM (#35949107)
> it is explosive in computation time

Hum... The numerical route for AI necessarily has the same complexity in computation time. Those two have equivalent semantics. If you can get a result with one, you can get the same result with the other, it can just differ on how easy it is to program.

By the way, symbolic AI can learn too, you don't need to model things in code.

Re:We Don't Know How to Compute (2011) [video] by leroy-is-here on Monday May 15, 2023 @12:53PM (#35951138)
I was talking about attempts such as expert systems. We attempted to symbolically encode things as sums of their parts in plain terms, e.g. a bicycle is two wheels, an axle, a chain, some peddles, etc. but in more detail than that. The problem is the level of detail required for general knowledge: firstly it is hard to codify, secondly as it grows computation becomes exponentially more expensive.

We as humans have the intelligence to simply see for fractions of a second and then just know — we can know the answers to math problems and how a person is feeling. The symbolic AI programming was an attempt to codify what symbols we are seeing but they are so diverse and nuanced it became apparent this was an ineffective scientific route.

Re:We Don't Know How to Compute (2011) [video] by marcosdumay on Monday May 15, 2023 @10:14PM (#35957092)
Yeah, that's because you decided it should be a hand-coded expert system. If you review the set of hand-coded neural networks, you will discover they even more bloated, and have an extreme low ceiling on usefulness.

Besides, keep in mind that the currently useful NNs are stuff that requires dozens of GB of memory to run.

Anyway, training a NN is also an attempt to codify what symbols we see on the world.

Re:We Don't Know How to Compute (2011) [video] by leroy-is-here on Tuesday May 16, 2023 @07:13AM (#35960182)
I’m not sure I understand your point at all. Of course I decided what I wrote — I wrote it. Of course training some AI is an attempt to codify the world, that’s the point.

My entire premise was about an _if_ between hand-coded logic and probabilistic training. Hand coding the logical internals of a neural network is one marriage, but there could be others.

Re:We Don't Know How to Compute (2011) [video] by lostmsu on Monday May 15, 2023 @06:29PM (#35955367)
I was talking about hardware rather then software here.

How do lane keeping assists work?

Re:We Don't Know How to Compute (2011) [video] by leroy-is-here on Tuesday May 16, 2023 @07:16AM (#35960209)
There’s no difference between hardware and software when it comes to running a program, really. They are both machines at the end of the day.