Re:Measuring Goodhart’s Law
by dr_dshiv on Wednesday April 13, 2022 @05:44PM
(#31020685)
What is best of n sampling? I didn’t follow. Is that like, which of these n images is best, and then turning that into a measure?
[ Parent
| on HN ]
Choose the top N according to the proxy objective and then use the real objective to choose the best out of those N candidates.
That was my initial understanding, which left me confused.
But they're taking the top n according to the model, then taking the top according to the proxy, not actual, objective. This avoids the Winner's Curse problem of top model ranking with reasonable probability.
They are then comparing this to the highest scoring actual preference.