Re:Show HN: Word2Bits – Quantized Word Vectors
by creichenbach on Tuesday March 20, 2018 @05:00AM
(#16626930)
Ah, so we'd divide our word (fragment) into parts and treat the parts like words for usage with CBOW or skipgram?
[ Parent
| on HN ]
Re:Show HN: Word2Bits – Quantized Word Vectors
by isoprophlex on Tuesday March 20, 2018 @11:23AM
(#16629333)
Uh yeah I have no idea if it'd perform well, but instead of having a sparse vector with the one-hot encoding of 'cargo', you enter a sparse vector with the 'car', 'arg' and 'rgo' dimensions set high.
Top of my head speculation, I never tried this...
Re:Show HN: Word2Bits – Quantized Word Vectors
by creichenbach on Wednesday March 21, 2018 @08:54AM
(#16637577)
Ah, that's actually not too far idea-wise from what we ended up doing: https://news.ycombinator.com/item?id=16637525