Re:T5: The Text-to-Text Transfer Transformer
by atomoton on Monday February 24, 2020 @04:31PM
(#22408657)
Wonder how this would compare with Watson at playing Jeopardy...
[ Parent
| on HN ]
Re:T5: The Text-to-Text Transfer Transformer
by halflings on Monday February 24, 2020 @04:44PM
(#22408769)
I would assume most QA (question answering) models blow Watson out of the water. A lot has been done since then.
See: https://aclweb.org/aclwiki/Question_Answering_(State_of_the_...
(I've done work in QA and have played at building Jeopardy style QA models)
Watson (Jeopardy Watson, not the IBM branding exercise Watson is now) has much weaker text understanding models, but has much much better optimisations for the incremental style of data release that you see in Jeopardy (ie, you get more and more data the longer you listen). IBM did a lot of work optimising when to answer as well as trying to get the correct answer.
The closest analogy that is regularly studied in modern QA research is "Quizbowl"-style datasets, but these tend to be much smaller than the SQUAD datasets that most modern neural network QA systems are built against.
Re:T5: The Text-to-Text Transfer Transformer
by benrbray on Monday February 24, 2020 @04:52PM
(#22408856)
Sure, but Jeopardy is all about AQ (Answer-Questioning) :)
Re:T5: The Text-to-Text Transfer Transformer
by 3wolf on Monday February 24, 2020 @08:25PM
(#22410165)
Probably better than this: https://twitter.com/jeopardygoat