News for hackers. Stuff that matters.
Re:AI benchmarks are a bad joke – and LLM makers are the one... by EdwardDiego on Sunday November 09, 2025 @02:18AM (#45863595)
And then when you ask if they disabled the query result cache before running their benchmarking, they blink and look confused.
Re:AI benchmarks are a bad joke – and LLM makers are the one... by nopurpose on Sunday November 09, 2025 @03:02AM (#45863793)
Then you see 25% cache hit rate in production and realise that disabling it for benchmark is not a good option either.