Re:Infinite Craft
by Calavar on Wednesday January 31, 2024 @03:30PM
(#39208947)
An LLM seems like overkill for a project like this. Why not word2vec?
[ Parent
| on HN ]
I had the same thought.
Some of the surprising discoveries I made with word2vec embeddings:
human + robot ~= cyborg
silicon + electricity ~= solar cells
virtual reality + reality ~= augmented reality
As reported here: https://web.archive.org/web/20160806040004if_/http://blog.yh...
how do you get human and robot?
More dimensions?
Re:Infinite Craft
by thatguysaguy on Wednesday January 31, 2024 @06:43PM
(#39211108)
The open vocabulary aspect seems important. Word2vec would never let me make "Pirate Pope Wars".
Re:Infinite Craft
by macromaniac on Wednesday January 31, 2024 @07:47PM
(#39211621)
I have made a similar thing a few months back, word2vec is inferior because it can't really do compound words, it sometimes returns unintuitive results, and then also you can't prompt it.
Re:Infinite Craft
by Silphendio on Thursday February 01, 2024 @07:38AM
(#39215324)
I thought this would be very simple to do, so I tried it.
https://silphendio.github.io/word2vec_alchemy/
That simple demo took me way too long and all that time is wasted because word2vec simply sucks for this use-case.