Re:Jev Meets the Trolley Problem
by hedora on Thursday October 15, 2026 @07:30PM
(#50111802)
The model gives a probability distribution as an answer; you can check to see if two arbitrarily chosen probability distributions are similar or not.
[ Parent
| on HN ]
Re:Jev Meets the Trolley Problem
by red75prime on Thursday October 15, 2026 @09:09PM
(#50112465)
I mean predicting the result of a fair coin toss is not a classification task those models are trained to do. It can be framed as a decision making task, but for a fair coin any probability distribution of heads/tails will do equally well.
BTW, for a task of predicting a 51/49 biased coin, the correct answer is 100/0.
Re:Jev Meets the Trolley Problem
by ezwoodland on Thursday October 15, 2026 @10:40PM
(#50113281)
Not if you use a proper scoring rule.
Re:Jev Meets the Trolley Problem
by red75prime on Thursday October 15, 2026 @11:17PM
(#50113591)
I'd say selecting a scoring rule that depends on the probability distribution (the Brier score, for example) changes the task from predicting the results of coin flips to predicting the distribution. Maybe it will work with a corresponding prompt.
Re:Jev Meets the Trolley Problem
by ezwoodland on Friday October 16, 2026 @03:00AM
(#50115066)
You can use a local proper scoring rule.