News for hackers. Stuff that matters.
Re:The Illustrated DeepSeek-R1 by throwup238 on Tuesday January 28, 2025 @09:30AM (#42852698)
No, you’re not. They explicitly mention in the R1 paper (in the last paragraph before the bibliography) that R1 isn’t a “huge” improvement over DeepSeek-V3 in coding - where “huge” is an academic weasel word.

It’s just a lot of hype. In my coding tests it significantly underperforms o1 (haven’t tried o1-pro), often getting stuck in a reasoning loop because I underspecified something (that I don’t have to with o1).

Re:The Illustrated DeepSeek-R1 by infecto on Tuesday January 28, 2025 @10:50AM (#42853681)
Same anecdotal experience. Its definitely an improvement and they have made operational improvements at runtime but I am still concerned they are have over fit for the tests.