News for hackers. Stuff that matters.
Re:What thousands of conversations look like inside a langua... by Scene_Cast2 on Sunday November 15, 2026 @08:46AM (#50506916)
The methodology feels either heavily undercooked to the point of being misleading, or heavily under explained. Why are we in 3D? At which point did dimensionality reduction hit? And if we're doing dimensionality reduction, does the "plane" really mean anything?
Re:What thousands of conversations look like inside a langua... by vhold on Sunday November 15, 2026 @08:59AM (#50506987)
It's under explained. It's in 3D because of PCA. It mentions PCA all over the place, but never even says what it is, less alone briefly describe what it does.

https://en.wikipedia.org/wiki/Principal_component_analysis

There are a lot of more fancy ways to reduce dimensions and create visualizations like these that tend to preserve more of the higher dimensional structure.

Here's a semi recent paper discussing and comparing some of them, I didn't dig too deep to try to find a more recent or better one : https://pmc.ncbi.nlm.nih.gov/articles/PMC12453773/

Re:What thousands of conversations look like inside a langua... by Scene_Cast2 on Sunday November 15, 2026 @09:11AM (#50507063)
I'm very familiar with PCA. There are so, so many ways you can apply it to this problem.

Assuming the simplest interpretation of what the analysis did, then it's saying "the variance of the biggest variance direction stays constant". Which in itself is an interesting thread to tug on, but the charts aren't how you'd present such a result.

Re:What thousands of conversations look like inside a langua... by thece0 on Sunday November 15, 2026 @09:12AM (#50507070)
Not familiar enough it seems. But PCA is outdated anyways
Re:What thousands of conversations look like inside a langua... by oldjohnnylane on Sunday November 15, 2026 @10:18AM (#50507521)
There’s no meat here. It’s just someone throwing data into a plotting tool with no meaningful results or conclusions. I was expecting a meaningful analysis. Nope.
Re:What thousands of conversations look like inside a langua... by pohl on Sunday November 15, 2026 @01:34PM (#50509400)
> Why are we in 3D?

Isn’t there an obvious answer to this? It’s about visualization. There’s a natural upper limit to dimensions we can see, and 3 is where we hit it.