Re:GPT-4 is getting worse over time, not better
by bluecrab on Wednesday July 19, 2023 @11:52AM
(#36788418)
That's false, the fact that I no longer rely on it is enough proof that it has gotten worse for me.
[ Parent
| on HN ]
Re:GPT-4 is getting worse over time, not better
by imtringued on Wednesday July 19, 2023 @12:25PM
(#36788998)
Continuous training is the holy grail. Yes you can just retrain with the updated dataset but guess what, you will run into catastrophic forgetting or end up in a different local minima.