News for hackers. Stuff that matters.

A comment on Transformers Can Do Arithmetic with the Right Embeddings.

Re:Transformers Can Do Arithmetic with the Right Embeddings by topherjaynes on Tuesday May 28, 2024 @02:44PM (#40504036)
I went through the paper and thought immediately about how did they implement it; I missed they published their code as well. Here is the link for everyone who skimmed past it: https://github.com/mcleish7/arithmetic/tree/main
[ Parent | on HN ]
Re:Transformers Can Do Arithmetic with the Right Embeddings by byt3h3ad on Tuesday May 28, 2024 @02:45PM (#40504054)
my bad, should have posted it with the link itself
[ Parent | on HN ]
Re:Transformers Can Do Arithmetic with the Right Embeddings by topherjaynes on Tuesday May 28, 2024 @02:51PM (#40504115)
Good to start with the concept, I just had so many implementation questions. Working through the code know... which is way harder to digest.
[ Parent | on HN ]