News for hackers. Stuff that matters.
Re:Next-Level Benchmarking Overfitting – Thomas Neumann by bob1029 on Wednesday November 11, 2026 @09:29AM (#50453874)
All benchmarks are vulnerable to manipulation.

At some point we need to trust the counterparty to do the right thing regarding how their product is represented relative to the benchmark. If someone repeatedly puts out deceptive figures the customer should eventually catch on and begin to disregard anything, not just the particular benchmark they happened to exploit.

Re:Next-Level Benchmarking Overfitting – Thomas Neumann by perching_aix on Wednesday November 11, 2026 @11:46AM (#50455484)
[delayed]