News for hackers. Stuff that matters.

A comment on Open Source AI Is the Path Forward. Parent comment

Re:Open Source AI Is the Path Forward by sebastiennight on Tuesday July 23, 2024 @04:52PM (#41050687)
It is possible to merge two fine-tunes of models from the same family by... wait for it... averaging or combining their weights[0].

I am still amazed that we can do that.

[0]: https://arxiv.org/abs/2212.09849

[ Parent | on HN ]
Re:Open Source AI Is the Path Forward by the8thbit on Thursday July 25, 2024 @04:58PM (#41073307)
This is absolutely wild.
[ Parent | on HN ]