News for hackers. Stuff that matters.
Re:Why Deep Learning Cannot Be Applied to Natural Languages ... by jayajay on Monday January 02, 2017 @04:57PM (#13304902)
Attention (see Google papers) seems like a pretty promising way of dealing with countable states. In quantum mechanics, we change the question we are asking. Instead of "which countable eigenstate are we in?", we ask "how much of our current state is in the Nth eigenstate?". We just expand our current state over the basis of interest. The coefficient of the state of interest is a continuous variable. This is what attention does for neural networks.

There are no comments on this comment yet.