News for hackers. Stuff that matters.
Re:Understanding Positional Embeddings in Modern LLMs by programjames on Sunday November 15, 2026 @12:18PM (#50508685)
When I see a title "Understanding..." I assume it will be about understanding theory not implementation or the theory of implementation. When I see a title "Surveying..." or "Understanding Implementation..." I assume it will be about surveying the implementation of that theory. There was just a title mismatch so I felt it was prudent to fill in the gap in understanding the blog did not cover.

Also, I expect the target audience of the blog is ML researchers, since he goes into some of the math, and umm... the kind of ML researcher that is not at least aware of the basics of abstract algebra is closer to an alchemist than a researcher.

Re:Understanding Positional Embeddings in Modern LLMs by monocasa on Sunday November 15, 2026 @01:53PM (#50509554)
I think you're constraining your language to a specific academic dialect and misapplying to other circumstances.

I don't expect a blog post to use the same phrasing as an academic article in several regards, including what you've described.