Re:New GitHub Copilot research finds 'downward pressure on c...
by ben_w on Tuesday January 30, 2024 @11:12AM
(#39191841)
I recognise the point, but also
> - drinking glass that is 99% hole-free
This describes my travel flask when the screw cap is on and the slot in the cap is open; most of my drinking glasses have (and need) a much bigger hole-to-surface ratio to get the fluid in and for me to drink from.
More relevantly for the output of an AI: in cases where testing is easy, a system which has a 99% chance of a producing a saleable drinking glass and just discards the other 1% to recycling isn't unreasonable… provided you can be sufficiently confident about the test.
For AI, the quality of the automated tests of the output is a very solid "it depends on what you're doing".
> - drinking glass that is 99% hole-free
This describes my travel flask when the screw cap is on and the slot in the cap is open; most of my drinking glasses have (and need) a much bigger hole-to-surface ratio to get the fluid in and for me to drink from.
More relevantly for the output of an AI: in cases where testing is easy, a system which has a 99% chance of a producing a saleable drinking glass and just discards the other 1% to recycling isn't unreasonable… provided you can be sufficiently confident about the test.
For AI, the quality of the automated tests of the output is a very solid "it depends on what you're doing".