News for hackers. Stuff that matters.
Re:You could have designed state of the art positional encoding by FL33TW00D on Monday November 18, 2024 @08:25AM (#42172097)
Hm! Very interesting! Thank you for taking the time to debug that.

I'm going to have to think hard about how to rewrite the motivating example to explain this best.

Edit: updated the post, thanks for pointing out the pernicious init values!

There are no comments on this comment yet.