ccccppppp
> Attention is basically a memory module, so if you don't need that it's just a waste of compute resources.
But aren't CNNs also like a memory module (ie: they memorize how leopard skin looks like)? I guess attention is a more sophisticated kind of memory, "more dynamic" so to speak.
Anyway, I'm glad to hear that a transformer architecture isn't totally stupid for my task, I will look up the literature, there seems to be a bit on this matter.
Critical point: for each particle you want to "teleport", you have recipient particle standing by to receive it.
And I would say "Don't know, let me check", but in Settings/About/Version it would show "7.0".
Then I would need to Google what number Oreo is.
Is as if propaganda works. Who would have thought.
Once I was discussing with a Chinese colleague and the Tiananmen subject came up (it was in the news, I didn't bring it up), and he told me that the students were not that innocent either, that they killed 150 soldiers the night before. I asked him, how could some students with rocks kill 150 soldiers with machine guns, but he said it was true. As suspected, I couldn't find any reputable sources for this later when I did extensive googling.
Just like not eating for one day (fasting) is not the same as not eating for weeks.
Not that many people affected, and there was massive help from the mainland.
Now imagine NYC without power for weeks.