Re:Language Models Are Super Mario: Absorbing Abilities from...
by l33tman on Saturday April 06, 2024 @12:15PM
(#39953404)
It would be cool if there was like a threshold in training from scratch, where after this actually works for adding higher level knowledge. So you would start training it like usual to get it to absorb generic langauge skills and reasoning but save all the domain knowledge absorption for merging later
[ Parent
| on HN ]
There are no comments on this comment yet.