Being confidently wrong is the only thing holding AI back

Re:Being confidently wrong is the only thing holding AI back by psadauskas on Friday August 22, 2025 @10:54AM (#44985388)

There's also the Pink Elephant Paradox (Whatever you do, DO NOT think about a pink elephant).

If you mention X or Y, even if they're preceded by "DO NOT" in all caps, an LLM will still end up with both X and Y into its context, making it more likely it gets used.

I'm running out of ways to tell the assistant to not use mocks for tests, it really really wants to use them.

[ Parent | on HN ]

Re:Being confidently wrong is the only thing holding AI back by vidarh on Friday August 22, 2025 @11:07AM (#44985549)

I think in some cases you "just" need to instead up temperature to increase the variety of responses, repeat requests, and use hooks to automatically review and reject bad options.

(And yes, it's a horrible workaround)

[ Parent | on HN ]