News for hackers. Stuff that matters.
Re:When to assume neural networks can solve a problem by 6gvONxR4sf7o on Monday March 30, 2020 @08:39PM (#22733830)
You demonstrated it for a reeeeeeeallly constrained version of the problem. Do you expect your solution would generalize to many lists? Because it would be easy to make a neural network that does, while your toy example (and larger generalizations) probably won't generalize super well.

x_i = ith list element from list x

y = sum(x_i * softmax(k * x)_i)

This one parameter, arbitrarily wide network one will get arbitrarily close to the max function.

This is a super toy version of why attention is so effective. It can pick stuff.

There are no comments on this comment yet.