News for hackers. Stuff that matters.

A comment on You Should Probably Pay Attention to Tokenizers. Parent comment

Re:You Should Probably Pay Attention to Tokenizers by SEGyges on Friday October 25, 2024 @04:56PM (#41949679)
it is not necessarily 16x if you, e.g., decrease model width by a factor of 4 or so also, but yeah naively the RAM and FLOPs scale up by n^2
[ Parent | on HN ]

There are no comments on this comment yet.