News for hackers. Stuff that matters.
Re: by ssivark on Thursday July 27, 2023 @07:09PM (#36901299)
What’s your take on the argument that fine tuning might be destroying model calibration and causing it to overfit to aspects of the finetuning dataset eg: causing it to appear more confident, rather than becoming more correct?

See https://twitter.com/animaanandkumar/status/16816906540601876...

Re: by jph00 on Thursday July 27, 2023 @09:12PM (#36902087)
That tweet is about a specific type of fine tuning: instruction tuning and RLHF. It causes to get better at the thing that it's being fine tuned for, which is making users feel better about the answer. Whether that's actually desirable in all cases is the question -- but that's not really related to whether fine tuning is a useful tool in general.