News for hackers. Stuff that matters.
Re:How AI is changing gymnastics judging by steveBK123 on Thursday January 25, 2024 @07:03AM (#39128631)
Exactly, its basically a variation of Goodhart's Law - “when a measure becomes a target, it ceases to be a good measure.”
Re:How AI is changing gymnastics judging by Nashooo on Thursday January 25, 2024 @07:31AM (#39128866)
Not really. It depends on the quality of the measure and any underlying assumptions. If the target is knowing who is the fastest then a simple stopwatch (measure) is 100% aligned with the target. So the measure becoming the target is completely fine.

The problem comes when one (or multiple) measure(s) are an approximation of some ideal measure for the target. For example the famous example [1] of the measuring rat tails to determine killed rats (target). The faulty assumption here was that the only way to hand in a rat's tail is by killing them.

[1] https://en.wikipedia.org/wiki/Great_Hanoi_Rat_Massacre

Re:How AI is changing gymnastics judging by IanCal on Thursday January 25, 2024 @08:33AM (#39129382)
> Not really. It depends on the quality of the measure and any underlying assumptions. If the target is knowing who is the fastest then a simple stopwatch (measure) is 100% aligned with the target. So the measure becoming the target is completely fine.

I get your point but with this case the measure is the target, so at no point does the "measurement become the target", it's aligned from the start. But then again, this is only true if your measure is of people performing the task you actually care about. If you want to know the fastest person and you measure over 100m you may end up with Bolt, which is great if you need "the fastest over 100m in a sprinting setup" but not if you need the fastest over a full marathon.

In general, it's an extremely good first approximation - many measures result in poor targets, and care needs to be taken when turning a measure into a target. Even then it usually becomes a worse measure.

> The faulty assumption here was that the only way to hand in a rat's tail is by killing them.

More than that, it's an assumption that an increase in rat tails equals a decrease in live rats. Even if you kill a rat to get a rat tail, that doesn't necessarily hold true. It rewards those that breed 5 rats, release 4 and hand in the tail of 1. Killed rats would have still been a bad target. The true target was fewer live rats. Dead rats can be a reasonable measure, but as a target it has very risky outcomes.

Re:How AI is changing gymnastics judging by je42 on Thursday January 25, 2024 @08:23AM (#39129296)
Unfortunately not true. It is not a single metric.

we have extra rules on top: No doping, separation of genders,...

Re:How AI is changing gymnastics judging by quench on Thursday January 25, 2024 @09:12AM (#39129725)
>Not really. It depends on the quality of the measure and any underlying assumptions. If the target is knowing who is the fastest then a simple stopwatch (measure) is 100% aligned with the target. So the measure becoming the target is completely fine.

I am thinking of how runners all lean forward just before the finish line. This must slow their overall speed but gets a part of their body to the measurement datum slightly quicker.

I admit its not a huge deviation between the measurement and the target but still it is an attempt to affect the measurement by means other than running fastest

Re:How AI is changing gymnastics judging by rondini on Thursday January 25, 2024 @10:34AM (#39130593)
I shouldn't be surprised given what website I'm on, but it's crazy that people will litigate the finer points of replacing human judgement of human arts rather than reject the premise outright.
Re:How AI is changing gymnastics judging by lupire on Thursday January 25, 2024 @11:05AM (#39131004)
If something is wrong, there should be an articulable reason Find it.
Re:How AI is changing gymnastics judging by pixl97 on Thursday January 25, 2024 @10:53AM (#39130839)
Why is this crazy? Should we toss the entire field of science and go back to judging reality based on our feeling and perceptions?
Re:How AI is changing gymnastics judging by psunavy03 on Thursday January 25, 2024 @11:01AM (#39130954)
Gymnastics is not a science. Judging "good" sports is purely an aesthetic choice.
Re:How AI is changing gymnastics judging by bluGill on Thursday January 25, 2024 @11:25AM (#39131280)
There is a science to gymnastics. However the judging is only minimally based on the science and mostly subjective.
Re:How AI is changing gymnastics judging by steveBK123 on Thursday January 25, 2024 @10:39AM (#39130657)
Yes precisely. For reference my most AI/LLM pilled friends are also Desktop Linux enthusiasts, for whatever that's worth..
Re:How AI is changing gymnastics judging by lupire on Thursday January 25, 2024 @11:04AM (#39130988)
That gets you people doing weird tricks to game the starting block and the finish line, which are artificial distractions from "fast running".
Re:How AI is changing gymnastics judging by saghm on Thursday January 25, 2024 @11:44AM (#39131535)
Only accepting entire rat bodies wouldn't necessarily work either; see the "cobra effect" that supposedly happened in colonial India: https://en.wikipedia.org/wiki/Perverse_incentive
Re:How AI is changing gymnastics judging by ta1243 on Thursday January 25, 2024 @07:37AM (#39128915)
There's a target of 9.8 seconds (or whatever) for the 100m sprint, there's a bunch of rules around things like windspeed, but it's still a good measure to find the "fastest man alive" despite being a target.
Re:How AI is changing gymnastics judging by DRAGONERO on Thursday January 25, 2024 @07:49AM (#39129010)
I think you mean “best shoe”
Re:How AI is changing gymnastics judging by RcouF1uZ4gsC on Thursday January 25, 2024 @08:03AM (#39129143)
You could wear the best most advanced shoes, and I bet you still couldn’t beat Usain Bolt wearing $10 sneakers.
Re:How AI is changing gymnastics judging by jcalx on Thursday January 25, 2024 @09:40AM (#39130025)
Two years post-retirement, wearing sweatpants and sneakers, he (albeit unofficially) tied the fastest 40-yard dash time at the NFL Combine: https://bleacherreport.com/articles/2818947-watch-usain-bolt...
Re:How AI is changing gymnastics judging by cedilla on Thursday January 25, 2024 @10:20AM (#39130431)
Isn't the measure already the target?
Re:How AI is changing gymnastics judging by kevinwang on Thursday January 25, 2024 @11:20AM (#39131204)
Another suitable maxim here is "We shape our tools and then our tools shape us"