News for hackers. Stuff that matters.

A comment on I want to wash my car. The car wash is 50 meters away. Should I walk or drive?. Parent comment

Re:I want to wash my car. The car wash is 50 meters away. Sh... by gf000 on Monday February 16, 2026 @02:46AM (#47032099)
Not the parent poster, but I did get the wrong answer even with reasoning turned on.
[ Parent | on HN ]
Re:I want to wash my car. The car wash is 50 meters away. Sh... by tezza on Monday February 16, 2026 @03:08AM (#47032261)
Thank you all! We needed further data points.

comparing one shot results is a foolish way to evaluate a statistical process like LLM answers. we need multiple samples.

for https://generative-ai.review I do at least three samples of output. this often yields very differnt results even from the same query.

e.g: https://generative-ai.review/2025/11/gpt-image-1-mini-vs-gpt...

[ Parent | on HN ]