News for hackers. Stuff that matters.

A comment on T5: The Text-to-Text Transfer Transformer.

Re:T5: The Text-to-Text Transfer Transformer by anigbrowl on Monday February 24, 2020 @06:56PM (#22409668)
To put these results in perspective, the T5 team went head-to-head with the model in a pub trivia challenge and lost!

Trivia fact recall and NLP seem like two quite different tasks even though both are required to do well in a quiz.

[ Parent | on HN ]
Re:T5: The Text-to-Text Transfer Transformer by craffel on Monday February 24, 2020 @07:39PM (#22409903)
Agreed! The interesting thing is that basic unsupervised pre-training seems to produce a model which functions not only as a knowledge base but also an NLU system which can effectively query the knowledge base using natural text questions. This is exactly what our follow-up paper is on.
[ Parent | on HN ]