DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Scaling RL

Re:DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Sc... by mluo on Tuesday February 11, 2025 @04:30PM (#43018627)

Try bfloat16! We have a bug where the model was saved as fp32.

[ Parent | on HN ]

Re:DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Sc... by simonw on Tuesday February 11, 2025 @04:47PM (#43018767)

I just tried it with this 3.6GB F16 model:

  ollama run hf.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF:F16

And this time it didn't get confused with the tokenization of strawberry! https://gist.github.com/simonw/9e79f96d69f10bc7ba540c87ea0e8...

[ Parent | on HN ]

Re:DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Sc... by mluo on Tuesday February 11, 2025 @05:09PM (#43019001)

Nice, very glad to see it works! Small models are very sensitive to the dtype :(

[ Parent | on HN ]