Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on RWKV: Reinventing RNNs for the Transformer Era. Parent comment
Every-time someone comes up and say "this is not attention, because it does X and not Y"
My response is, ok, what would you call it then? Because no one (including me) seem to to able to find a better term, that fits its use case.
There are no comments on this comment yet.
Every-time someone comes up and say "this is not attention, because it does X and not Y"
My response is, ok, what would you call it then? Because no one (including me) seem to to able to find a better term, that fits its use case.