Re:DeepSeek V4 Pro 0813
by lousken on Wednesday August 12, 2026 @02:43PM
(#49276833)
Are we testing the model or the harness? If benchmarks show certain numbers it should perform as such without it
[ Parent
| on HN ]
Re:DeepSeek V4 Pro 0813
by ApolloFortyNine on Wednesday August 12, 2026 @04:08PM
(#49277903)
You can't even run a benchmark without a basic harness, of course the harness has some effect.
Re:DeepSeek V4 Pro 0813
by 0xbadcafebee on Wednesday August 12, 2026 @04:47PM
(#49278337)
Yep. It's a state machine; change the state, change the result. https://arxiv.org/html/2605.23950v1 | https://arxiv.org/pdf/2505.15146 | https://medium.com/@amontzamir/youre-praising-the-wrong-thin...