News for hackers. Stuff that matters.
Re:Understanding Positional Embeddings in Modern LLMs by tsimionescu on Sunday November 15, 2026 @05:34PM (#50511595)
Particles yes, but not electrons, quarks, etc. The math gives you "point-like things that have momentum and spin". The gauge groups give you charge, color, weak hypercharge (and the associated interactions). And then you add actual parameters you have to get from experiments to discover which of the infinite number of possible particles that have these characteristics actually exist. For example, nothing in the pure math will tell you that there has to exist a particle with electrical charge but no color charge, like the electron and the positron - this is a fact about the universe that comes out of experiments.
Re:Understanding Positional Embeddings in Modern LLMs by skew-aberration on Sunday November 15, 2026 @08:07PM (#50512788)
Regardless, that line of reasoning would still seem counterproductive to me, even if it did predict electrons.

We have found particles and empirically identified their symmetries. To model the propagations of the particles' fields, we replace those discrete symmetries by corresponding continuous ones. Then, we are shocked to find that we can work backwards from the continuous symmetries to the discrete ones again!

The continuous symmetries are widely taken to be the fundamental thing, because they make the math of Lagrangian mechanics easier, and in QFT we can 'quantize the field'. I don't this stands up to philosophical scrutiny though. We don't actually have 'electrons rotated by 10 degrees', we only have 'electron field excitation with momentum p, rotated by 10 degrees phase'.