Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang...
by PaulHoule on Thursday February 23, 2023 @07:55AM
(#34909851)
They started with a pre trained model so symmetries were already broken, so despite what randomness there is in the fine-tuning process it may have well followed the same groove every time in training.
[ Parent
| on HN ]
There are no comments on this comment yet.