Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang...
by starbugs on Thursday January 25, 2024 @04:08PM
(#39135321)
Certainly there’s this problem in many areas.
I was just wondering how big of a deal that might be in this case. Just had another of those experiences with GPT4 where it goes into a contradictory loop it cannot recover from.
It seems there might be a big difference between long term cycles and short term severe degradation as in inbreeding and this paper‘s abstract sounded a bit like that to me.
If the results indicate improved performance, then it doesn’t seem to be that big of a deal (yet?).
I was just wondering how big of a deal that might be in this case. Just had another of those experiences with GPT4 where it goes into a contradictory loop it cannot recover from.
It seems there might be a big difference between long term cycles and short term severe degradation as in inbreeding and this paper‘s abstract sounded a bit like that to me.
If the results indicate improved performance, then it doesn’t seem to be that big of a deal (yet?).
Thanks for the explanation!