News for hackers. Stuff that matters.
Re:Direct initialization of transformers using larger pretra... by mirekrusin on Friday December 22, 2023 @04:47PM (#38739054)
Looks like typo, from chart it seems to be around 20x10^9 for weight subcloning (doesn't look like 16x10^9 <<which would be 4x>> either).

There are no comments on this comment yet.