Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang...
by maaaaattttt on Thursday February 23, 2023 @09:24AM
(#34910922)
Not an expert at all (so not a rhetorical question) but wouldn't that be what people are doing with using pre-trained model for new tasks?
There's just some predefined wiring that is a good bet, and the expression into a phenotype or some other mechanism for encoding some of this knowledge in future generations.
Future AI can just start off with a good baseline and build from there.