Re:Understanding word vectors
by kevinwang on Friday March 02, 2018 @03:16PM
(#16505286)
It seems obvious to me that disambiguating _correctly_ would necessarily improve performance. As an extreme example, homonyms like bark (the verb) and bark (on a tree) have nothing to do with each other, and ideally would be considered two different words.
[ Parent
| on HN ]
I imagine contranyms would be among the most difficult here. Would be fun to see how these vectors stack up with those.
Well, antonyms are usually right next to each other in word embedding spaces anyways. (since the context they're used in is often hard to tell apart)
Contranyms would be identical in the embedding space, no?
I'm actually intrigued that nobody has made a text processor named after https://en.wikipedia.org/wiki/Amelia_Bedelia yet. :)
Yeah I would agree. I've struggled to find much work that looks at this at a large scale though!
Re:Understanding word vectors
by nicklovescode on Friday March 02, 2018 @06:32PM
(#16506721)
AllenNLP’s recent work ELMo is very good at this task. Check it out!