News for hackers. Stuff that matters.
Re:RWKV: Reinventing RNNs for the Transformer Era by pico_creator on Tuesday May 23, 2023 @05:20AM (#36041835)
Haha, yea - naming things is hard

Every-time someone comes up and say "this is not attention, because it does X and not Y"

My response is, ok, what would you call it then? Because no one (including me) seem to to able to find a better term, that fits its use case.

There are no comments on this comment yet.