Re:Understanding Positional Embeddings in Modern LLMs
by programjames on Sunday November 15, 2026 @05:22PM
(#50511471)
The Euclidean group is a Wick rotation off from the Poincaire group. I think it is valid to call these particles. You can tack on the gauge group later to get your 'qualia'.
Re:Understanding Positional Embeddings in Modern LLMs
by tsimionescu on Sunday November 15, 2026 @05:34PM
(#50511595)
Particles yes, but not electrons, quarks, etc. The math gives you "point-like things that have momentum and spin". The gauge groups give you charge, color, weak hypercharge (and the associated interactions). And then you add actual parameters you have to get from experiments to discover which of the infinite number of possible particles that have these characteristics actually exist. For example, nothing in the pure math will tell you that there has to exist a particle with electrical charge but no color charge, like the electron and the positron - this is a fact about the universe that comes out of experiments.
Re:Understanding Positional Embeddings in Modern LLMs
by skew-aberration on Sunday November 15, 2026 @08:07PM
(#50512788)
Regardless, that line of reasoning would still seem counterproductive to me, even if it did predict electrons.
We have found particles and empirically identified their symmetries. To model the propagations of the particles' fields, we replace those discrete symmetries by corresponding continuous ones. Then, we are shocked to find that we can work backwards from the continuous symmetries to the discrete ones again!
The continuous symmetries are widely taken to be the fundamental thing, because they make the math of Lagrangian mechanics easier, and in QFT we can 'quantize the field'. I don't this stands up to philosophical scrutiny though. We don't actually have 'electrons rotated by 10 degrees', we only have 'electron field excitation with momentum p, rotated by 10 degrees phase'.
Plus, calling the particles that you get out of such a theory "the electron" or "the quark" is profoundly misleading. If you only start with a space-time related symmetry, you don't get "electrons", you maybe get particles with the spin and mass of an electron. But it doesn't have charge, nor color nor weak hypercharge. It doesn't decay and doesn't absorb photons nor do anything else that an electron does - it's not an electron. You need to combine this with a lot more symmetry groups to start getting the actual particles, and even then you still need to add the experimentally discovered values to match physics - the math allows for infinite numbers of various particles with properties similar to the ones our universe actually contains.
I'd also note that apparently the Euclidean group doesn't have anything to do with particles anyway, it's the Poincarre group whose irreducible symmetries lead to the (mass, spin) description of particles.