Re:DeepScaleR: Surpassing O1-Preview with a 1.5B Model by Sc...
by jazzyjackson on Tuesday February 11, 2025 @05:24PM
(#43019152)
I have to take all these comparisons with a heap of salt because no one bothers to run the test 20 times on each model to smooth out the probabalistic nature of the LLM landing on the right answer. There must be some fallacy for this, that you would sample once from each and declare a definitive winner, I see it all the time.
[ Parent
| on HN ]
There are no comments on this comment yet.