News for hackers. Stuff that matters.
Re:Language Models Are Super Mario: Absorbing Abilities from... by zingelshuher on Saturday April 06, 2024 @10:29PM (#39957659)
Intuitively looks like models should be close enough, or sparse enough for merge to work. I wonder if MoE experts can be merged(?)

There are no comments on this comment yet.