pokkanome
pokkanome on Hacker News
I am using computation in the strictly mathematical sense. As in dealing with numbers. I do not think that our minds operate through a constant stream of numbers that become thoughts.
In that way, a computer and a human are fundamentally different. You cannot stimulate human thoughts as pure numbers. I think we need some extra layer of yet-to-be-invented abstraction to achieve that goal.
Of course, we could go the route of trying to create a new model of thought based around numbers, but that is proving to be difficult to understand. It would not be a good idea to try to build an intelligent system that we cannot completely understand because then all we could do is hope it works as we intended.
A transistor is not doing computation. It is flipping a bit. Those bits are flipped in binary patterns with logic gates to do the computation.
And a transistor is not a neural network node.
And what evidence do you have that human neurons do any kind of computation at all?
Generally, they are stimulated by some sensation until they reach a certain threshold that causes them to fire. That is the basic kind of functionality that nodes in a neural network try to simulate.
But human neurons are not dependent on numbers and change in much more complex ways than a few parameters. The brain requires a lot less data than these networks to learn new concepts. And the concepts that these networks learn are all ideas that humans came up with.
A network does not hold an opinion, it takes in inputs and gives outputs. I do not mean to say that we cannot make a network to simulate a brain, but that is not what we have right now.
Using the word "feels" (or "thinks") is a too much of a personification of a neural network. You cannot forget that under the hood, it is cranking through a bunch of math functions. You always get the same output from the same input. That function is not going to change on its own, and it is not going to suddenly gain new abilities to express itself in words. It is not a human, so there is no point in assuming it will behave or grow like a human.
The biggest problem I see to training a network to program is that it would require a lot of example programs to serve as training data. Which means we need a lot of really good, bug free programs that already accomplish similar tasks. And in my opinion, we do not have enough reliable seed programs to make anything useful, at least currently.
It is very easy to take a picture of a car and tell a computer what it is, not so easy to write a program and explain to a computer what it does.
Neural Networks do not think. They perform a series of computations, and arrive at a result. It is not intelligence. It is a very useful tool for solving problems that can be quantified and that we can generate a lot of data from, but ultimately, it is still human intelligence that is interpreting the problem and result.