Re:Language Models Are Super Mario: Absorbing Abilities from...
by zingelshuher on Saturday April 06, 2024 @10:29PM
(#39957659)
Intuitively looks like models should be close enough, or sparse enough for merge to work. I wonder if MoE experts can be merged(?)
[ Parent
| on HN ]
There are no comments on this comment yet.