News for hackers. Stuff that matters.

A comment on T5: The Text-to-Text Transfer Transformer. Parent comment

Re:T5: The Text-to-Text Transfer Transformer by dmit on Monday February 24, 2020 @06:44PM (#22409597)
I'm sorry for being blunt, but is it possible that the `very brittle "exact match" method of evaluating whether an answer is correct` means value equality? Is `==` the secret sauce?
[ Parent | on HN ]
Re:T5: The Text-to-Text Transfer Transformer by craffel on Monday February 24, 2020 @06:54PM (#22409653)
It's slightly more than that -- it also involves lowercasing and removing articles before testing for string equality.
[ Parent | on HN ]