News for hackers. Stuff that matters.

A comment on Ask HN: Can someone ELI5 Transformers and the “Attention is all we need” paper. Parent comment

Re:Ask HN: Can someone ELI5 Transformers and the “Attention ... by throwawaymaths on Wednesday May 17, 2023 @04:41PM (#35981005)
Hashing does not have to be random, it just has to compress the domain. Modulo prime number is a perfectly valid hash for some use cases.
[ Parent | on HN ]

There are no comments on this comment yet.