Google T5 scores 88.9 on SuperGLUE Benchmark, approaching human baseline

Re:Google T5 scores 88.9 on SuperGLUE Benchmark, approaching... by changoplatanero on Thursday October 24, 2019 @11:11PM (#21351516)

"I eat my rice with butter." could mean that you use butter as a utensil to eat your rice with. There is often an unlikely way of parsing the sentence that gives an alternate meaning. The point is to test the computer to see if it can distinguish the likely parse from an unlikely one.

[ Parent | on HN ]

Re:Google T5 scores 88.9 on SuperGLUE Benchmark, approaching... by nl on Thursday October 24, 2019 @11:29PM (#21351613)

These aren't really alternate _parses_ though (in the sense that they don't give different parse trees). They do highlight the different possible meanings of "with" though.

I think "I eat my rice with chicken" vs "I eat my rice with children" vs "I eat my rice with chopsticks" is the canonical example here.

There's a whole field in NLP involved in showing what changes happen to entities mentioned in a sentence as a a side effect of the sentence, and this example shows it pretty well.

[ Parent | on HN ]

Re:Google T5 scores 88.9 on SuperGLUE Benchmark, approaching... by changoplatanero on Friday October 25, 2019 @02:27AM (#21352433)

Wouldnt those be different parse trees? Like the "with X" could either be attached either to the verb or the noun

[ Parent | on HN ]

Re:Google T5 scores 88.9 on SuperGLUE Benchmark, approaching... by lultimouomo on Friday October 25, 2019 @02:59AM (#21352586)

I think it's more clear if you say "I usually eat X with Y", i.e. Y it's either the company, the tool or the condiment that you eat with (contrasted with "I'm eating my X", where X is a dish like "rice with chicken")

[ Parent | on HN ]

Re:Google T5 scores 88.9 on SuperGLUE Benchmark, approaching... by nl on Friday October 25, 2019 @02:56AM (#21352574)

Yes, possibly.

[ Parent | on HN ]