News for hackers. Stuff that matters.
Re:Latent Dictionary: 3D map of Oxford3000+search words via ... by kvakkefly on Saturday December 30, 2023 @10:03AM (#38815755)
By running the same multiple times, I get different visualization. I don't really understand what's going on, but I like the idea of visualizing embeddings.
Re:Latent Dictionary: 3D map of Oxford3000+search words via ... by wrsh07 on Saturday December 30, 2023 @11:26AM (#38816436)
I think the PCA dimensionality reduction is non deterministic, but I say this with really low confidence
Re:Latent Dictionary: 3D map of Oxford3000+search words via ... by soVeryTired on Saturday December 30, 2023 @11:35AM (#38816499)
PCA is purely deterministic (and might not give great results). My guess is this is done by t-sne or UMAP, both of which depend on a seed.
Re:Latent Dictionary: 3D map of Oxford3000+search words via ... by minimaxir on Saturday December 30, 2023 @02:52PM (#38818411)
The About page explicitly says it's PCA.

PCA is fine enough to get it into 3D.