News for hackers. Stuff that matters.
Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang... by PaulHoule on Thursday February 23, 2023 @07:55AM (#34909851)
They started with a pre trained model so symmetries were already broken, so despite what randomness there is in the fine-tuning process it may have well followed the same groove every time in training.

There are no comments on this comment yet.