Re:Being confidently wrong is the only thing holding AI back
by gavinray on Friday August 22, 2025 @09:07AM
(#44984198)
I'd be curious if you could share some poor-performing prompts.
I would be willing to record myself using them across paid models with custom instructions and see if the output is still garbage.
Re:Being confidently wrong is the only thing holding AI back
by mrguyorama on Friday August 22, 2025 @04:07PM
(#44989193)
This is just the new version of "works on my machine". Oh, I was able to contrive a correct answer from my prompt because the random number generator smiled upon me today.
That's not useful.
But I've had it consistently happens to me on tiny contexts (e.g. I've had to spend time trying - and failing - to get it to fix a mess it was making with a straightforward 200-ish line bash script).
And its also very frequently happened to me when I've been very careful with my prompts (e.g. explicitly telling it to use a specific version of a specific library ... and it goes and ignores me completely and picks some random library).