Google T5 scores 88.9 on SuperGLUE Benchmark, approaching human baseline

Re:Google T5 scores 88.9 on SuperGLUE Benchmark, approaching... by Double_a_92 on Friday October 25, 2019 @07:50AM (#21354023)

Sometimes the questions are also just broken. I.e. asking you to select the things that do not apply, but the answer would have been to opposite.

[ Parent | on HN ]

Re:Google T5 scores 88.9 on SuperGLUE Benchmark, approaching... by Huppie on Friday October 25, 2019 @08:22AM (#21354231)

Back when I took the 'C# certification' (70-483 I think?) there were multiple questions in the style 'which of the following answers will make the program compile', where all four answers had a syntax error, or the program had a syntax error at a different line that would cause an issue regardless of your answer.

I tried the dispute process but it's basically impossible to dispute / report broken questions unless you have a photographic memory.

[ Parent | on HN ]