Re:NLP's ImageNet Moment: From Shallow to Deep Pre-Training
by sebastianruder on Monday July 09, 2018 @01:39PM
(#17491972)
WordNet (as you probably know) is a database that groups English words into a set of synonyms. If you consider WordNet as a clustering of high-level classes, then you could argue that ImageNet is the "WordNet for vision", meaning the clustering of object classes.
The article uses a different meaning of ImageNet, namely ImageNet as pretraining task that can be used to learn representations that will likely be beneficial for many other tasks in the problem space. In this sense, you could use WordNet as an "ImageNet for language" e.g. by learning word representations based on the WordNet definitions. This is something people have done, but there are a lot more effective approaches.
I hope this helped and was not too convoluted.
[ Parent
| on HN ]
Re:NLP's ImageNet Moment: From Shallow to Deep Pre-Training
by neuromantik8086 on Monday July 09, 2018 @01:51PM
(#17492076)
Does WordNet know that the word "ImageNet" refers to both a database and a pretraining task? :)
Re:NLP's ImageNet Moment: From Shallow to Deep Pre-Training
by wodenokoto on Monday July 09, 2018 @04:04PM
(#17493015)
No, it does not know that, or anything else about "ImageNet"
http://wordnetweb.princeton.edu/perl/webwn?c=8&sub=Change&o2...