News for hackers. Stuff that matters.
Re:Google T5 scores 88.9 on SuperGLUE Benchmark, approaching... by pdkl95 on Thursday October 24, 2019 @09:55PM (#21351101)
> Can't this be said about any benchmark?

Maybe it should be? The "dieselgate" talk[1] at 32c3 suggests engineering has gotten very good[2] at "teaching machines to the test".

[1] https://media.ccc.de/v/32c3-7331-the_exhaust_emissions_scand... (good text summary: https://lwn.net/Articles/670488/ )

[2] https://static.lwn.net/images/2016/vw-curves.png

There are no comments on this comment yet.