How to teach a Bayesian spam filter to play chess

Re:How to teach a Bayesian spam filter to play chess by pixcavator on Friday November 02, 2007 @11:21PM (#75710)

Suppose you have a function f of two variables and all you know about it is that f(x,y)=x+y for a few values of x,y. With this data, the computer extrapolates linearly and finds f(x,y) for _all_ values of x,y. The computer just "learnt" how to add! If all you have is symbols, however, you have to have numbers associated with those symbols. But you can't expect 1 correspond to '1' and 2 to '2'. As a result, your function f - and its extrapolation - will have nothing to do with addition (f won't even be linear).

[ Parent | on HN ]

Re:How to teach a Bayesian spam filter to play chess by aswanson on Friday November 02, 2007 @11:49PM (#75714)

So am I correct in assuming that you are looking for a machine that can do the mapping of a symbol into a form that the function can learn from? Your visual and auditory systems do this, and since they are physical systems this mapping is computable.

By the way, for the addition example , the neural network needs only one example, e.g. 1+1=2, applied repeatedly to discover the addition of any two inputs. There is no extrapolation between examples needed in this case.

[ Parent | on HN ]

Re:How to teach a Bayesian spam filter to play chess by pixcavator on Saturday November 03, 2007 @07:28AM (#75752)

"Extrapolation is the process of constructing new data points outside a discrete set of known data points."

[ Parent | on HN ]

Re:How to teach a Bayesian spam filter to play chess by aswanson on Saturday November 03, 2007 @08:35AM (#75764)

I have rethought what you have said, and I think I am now closer to understanding what your question is. You are posing the question of what to do with an input, not the operation itself. For instance, if I feed the network an image of 5 and 3, with the output being the image 8, the network would not perform addition but some other functional mapping. Is that the feature you are suggesting that it should 'understand'?

[ Parent | on HN ]

Re:How to teach a Bayesian spam filter to play chess by pixcavator on Saturday November 03, 2007 @10:52PM (#75947)

Yes.

[ Parent | on HN ]

Re:How to teach a Bayesian spam filter to play chess by aswanson on Saturday November 03, 2007 @08:22AM (#75760)

Right. Confusing extrapolation with interpolation.

[ Parent | on HN ]