News for hackers. Stuff that matters.
Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang... by markburns on Thursday February 23, 2023 @09:08AM (#34910745)
I wonder if this could be used as a step towards explaining innate abilities. You're born with a human brain capable or language. A giraffe is born with a brain capable of walking.

There's just some predefined wiring that is a good bet, and the expression into a phenotype or some other mechanism for encoding some of this knowledge in future generations.

Future AI can just start off with a good baseline and build from there.

Re:Knowledge Is a Region in Weight Space for Fine-Tuned Lang... by maaaaattttt on Thursday February 23, 2023 @09:24AM (#34910922)
Not an expert at all (so not a rhetorical question) but wouldn't that be what people are doing with using pre-trained model for new tasks?