Re:Revealing example of self-attention, the building block o...
by zxexz on Saturday April 29, 2023 @08:55PM
(#35758750)
I made the same mistake recently! It doesn’t help that there are so many poorly documented repos that make similar mistakes (and worse yet, half baked medium articles that blatantly give false information). Directly translating papers to PyTorch is hard too, I really wish there was a better API to express these models in that aligns better with how they’re actually documented in papers.
[ Parent
| on HN ]
There are no comments on this comment yet.