News for hackers. Stuff that matters.
Re:Show HN: Wikipedia2Vec – A tool for learning embeddings o... by ikuyamada on Thursday August 02, 2018 @11:26PM (#17677101)
We did not add Fasttext to our benchmarks because of a minor technical issue but we will work on it. Further, to conduct a fair comparison with ELMo, I think it is needed to use extrinsic tasks such as question answering and textual entailment.
Re:Show HN: Wikipedia2Vec – A tool for learning embeddings o... by riku_iki on Friday August 03, 2018 @03:03PM (#17682658)
You can build very simple 100 lines benchmark e.g. doing IMDB dataset classification, and use ELMO and your embeddings, and see who will perform better..
Re:Show HN: Wikipedia2Vec – A tool for learning embeddings o... by ikuyamada on Sunday August 05, 2018 @08:58PM (#17694468)
Thank you for your feedback! I am also interested in conducting experiments on extrinsic tasks such as text classification. In addition to word embeddings, Wikipedia2Vec also contains entity embeddings which are likely beneficial for these tasks, so I would like to design a model that uses both the word embeddings and entity embeddings.