News for hackers. Stuff that matters.
Re:Gemini 3 Pro Preview Live in AI Studio by fluoridation on Wednesday November 19, 2025 @10:31AM (#45980810)
I think the real killer feature would be that they stop making basic mistakes, and that they gain some introspection. It's not a problem if they're wrong 30% of the time if they're able to gauge their own confidence like a human would. Then you can know to disregard the answer, or check it more thoroughly.
Re:Gemini 3 Pro Preview Live in AI Studio by xpe on Wednesday November 19, 2025 @12:02PM (#45981922)
> It's not a problem if they're wrong 30% of the time if they're able to gauge their own confidence like a human would.

This is a case where I would not use human performance as the standard to beat. Training people to be both intellectually honest and statistically calibrated is really hard.

Re:Gemini 3 Pro Preview Live in AI Studio by fluoridation on Wednesday November 19, 2025 @01:13PM (#45982815)
Perhaps, but an AI that can only answer like a precocious child who's spent years reading encyclopedias but has not learned to detect when it's thinking poorly or not remembering clearly is much less useful.