News for hackers. Stuff that matters.

A comment on Byte Latent Transformer: Patches Scale Better Than Tokens. Parent comment

Re:Byte Latent Transformer: Patches Scale Better Than Tokens by anon291 on Monday May 12, 2025 @04:55PM (#43967380)
It's true, but you can't deny the importance of the architecture. It's pretty clear that using simple perceptrons would not have led us down the same path.
[ Parent | on HN ]
Re:Byte Latent Transformer: Patches Scale Better Than Tokens by Retric on Monday May 12, 2025 @05:26PM (#43967603)
Sure, but I think a reasonable corollary is that new algorithms and architectures will show their strengths when new realms of computation become available.
[ Parent | on HN ]