News for hackers. Stuff that matters.

A comment on DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Scaling RL. Parent comment

Re:DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Sc... by rvnx on Tuesday February 11, 2025 @05:32PM (#43019232)
It is great discovery, it could even open a next step in AI with MoM "Mixture of Models", where small fine-tuned models take each part of a task (instead of the current MoE)
[ Parent | on HN ]
Re:DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Sc... by mluo on Tuesday February 11, 2025 @05:34PM (#43019252)
Check out one of my prior work: https://stylus-diffusion.github.io/

This work scales up selection/routing over many models/LoRAs

[ Parent | on HN ]
Re:DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Sc... by rvnx on Tuesday February 11, 2025 @05:35PM (#43019254)
Love it, will check, thank you for showing / sharing all of that!
[ Parent | on HN ]