Re:Latent Dictionary: 3D map of Oxford3000+search words via ...
by smrtinsert on Saturday December 30, 2023 @01:13PM
(#38817318)
I would love a quickest path between two words. For example between color and colour
[ Parent
| on HN ]
Re:Latent Dictionary: 3D map of Oxford3000+search words via ...
by tudorw on Saturday December 30, 2023 @01:28PM
(#38817468)
I think that's going to be a geodesic in a hyper-dimensional manifold. There was an article here about 'wordlets' on a hyper-sphere and a piece on time and LLM and the relating manifold. Visualising LLM topology (multi-dimensional topological manifolds) is a very rich area for exploration. I'm waiting for someone to use PHATE to do the dimension reduction, it's used in neuroscience to reduce dimensionality providing information not visible using PCA, t-SNE, LDA or UMAP.
Re:Latent Dictionary: 3D map of Oxford3000+search words via ...
by patcon on Saturday December 30, 2023 @02:43PM
(#38818323)
Yep, been thinking on that paper as well:
Traveling words. There's code! https://arxiv.org/abs/2309.07315
Re:Latent Dictionary: 3D map of Oxford3000+search words via ...
by tikimcfee on Saturday December 30, 2023 @06:35PM
(#38820377)
This is so damn cool! You just showed me something that may change the course of my ideation, current project, and who I may talk to. Thank you so much for sharing.
Words in space. It’s finally freaking happening!!!