News for hackers. Stuff that matters.
Re:The Transformer Family by rcme on Sunday January 29, 2023 @09:30PM (#34575186)
I think the concepts are simple. After all, everything is just a mutli-variable derivative. However, I find the choice of notation very confusing. Mostly because it's impossible to remember the shape of everything.

Even if this linked post, they have a "notations" section at the top. Almost immediately, they start using a value k that isn't defined anywhere.

Re:The Transformer Family by 0cf8612b2e1e on Monday January 30, 2023 @12:24AM (#34576100)
Not that I think statistics terminology or notation is worthy of praise (it’s mostly horrible), but it frustrates me to no end how the ML world reappropriated terms seemingly just to be different.