News for hackers. Stuff that matters.
Re:Inference-Aware Fine-Tuning for Best-of-N Sampling in Lar... by diwank on Monday April 28, 2025 @01:19AM (#43817820)
For reasoning models, this would actually improve exploration efficiency and hence possibly allow higher performance for the same compute budget. As in, if you want to sample from multiple rollouts for the same prompt, it's more efficient if the model is able to produce diverse thought directions and consider them to find the best response as opposed to going down similar trajectories and waste compute.

There are no comments on this comment yet.