News for hackers. Stuff that matters.
Re:Transformers as Support Vector Machines by ftxbro on Sunday September 03, 2023 @11:09AM (#37371024)
OK but why they write "benign optimization landscape devoid of stationary points" instead of "convex" other than "just for show"? In my understanding it's not better for either audience experts or laymen. For experts it would be more clear to just say convex and they would know the implications, and if someone doesn't know what convex means they probably also aren't going to be on board with 'stationary points'. Also I'm not trying to pick on the authors I'm just trying to answer the question of which specific parts could be seen as 'just for show'.
Re:Transformers as Support Vector Machines by sdenton4 on Sunday September 03, 2023 @11:26AM (#37371141)
Because if you say convex, you better damned well have a proof of convexity...