News for hackers. Stuff that matters.
Re:Understanding word vectors by kevinwang on Friday March 02, 2018 @03:16PM (#16505286)
It seems obvious to me that disambiguating _correctly_ would necessarily improve performance. As an extreme example, homonyms like bark (the verb) and bark (on a tree) have nothing to do with each other, and ideally would be considered two different words.
Re:Understanding word vectors by taeric on Friday March 02, 2018 @07:01PM (#16506868)
I imagine contranyms would be among the most difficult here. Would be fun to see how these vectors stack up with those.
Re:Understanding word vectors by kevinwang on Friday March 02, 2018 @08:19PM (#16507236)
Well, antonyms are usually right next to each other in word embedding spaces anyways. (since the context they're used in is often hard to tell apart)
Re:Understanding word vectors by taeric on Saturday March 03, 2018 @11:40AM (#16510061)
Contranyms would be identical in the embedding space, no?

I'm actually intrigued that nobody has made a text processor named after https://en.wikipedia.org/wiki/Amelia_Bedelia yet. :)

Re:Understanding word vectors by aglionby on Friday March 02, 2018 @03:21PM (#16505326)
Yeah I would agree. I've struggled to find much work that looks at this at a large scale though!
Re:Understanding word vectors by nicklovescode on Friday March 02, 2018 @06:32PM (#16506721)
AllenNLP’s recent work ELMo is very good at this task. Check it out!
Re:Understanding word vectors by aglionby on Friday March 02, 2018 @06:45PM (#16506783)
Much appreciated! Will have a look.