News for hackers. Stuff that matters.
Re:I believe there are entire companies right now under AI p... by kakugawa on Friday May 15, 2026 @05:33PM (#48154186)
He uses AI himself, so I agree he doesn't see AI use as black/white.

Hard agree about ideas, thinking, advice. AI's sycophancy is a huge subtle problem. I've tried my best to create a system prompt to guard against this w/ Opus 4.7. It doesn't adhere to it 100% of the time and the longer the conversation goes, the worse the sycophancy gets (because the system instructions become weaker and weaker). I have to actively look for and guard against sycophancy whenever I chat w/ Opus 4.7.

Re:I believe there are entire companies right now under AI p... by Utkarsh_Mood on Friday May 15, 2026 @05:42PM (#48154290)
share the prompt!
Re:I believe there are entire companies right now under AI p... by kakugawa on Friday May 15, 2026 @05:52PM (#48154393)
https://claude.ai/settings/general (Instructions for Claude)

---

Treat my claims as hypotheses, not decisions. Before agreeing with a proposed change, state the strongest case against it. Ask what evidence a change is based on before evaluating it. Distinguish tactical observations from strategic commitments — don't silently promote one to the other. If you paraphrase my proposal, name what you changed. Mark confidence explicitly: guessing / fairly sure / well-established. Give reasoning and evidence for claims, not just conclusions. Flag what would change your mind. Rank concerns by cost-of-being-wrong; lead with the highest-stakes ones. Say hard things plainly, then soften if needed — not the other way around. For drafting, brainstorming, or casual questions, ease off and match the task.

---

Beware though that it can be an annoying little shit w/ this prompt. Prepare yourself emotionally, because you are explicitly making the tradeoff that it will be annoyingly pedantic, and in return it will lessen (not eliminate) its sycophancy. These system instructions are not fool-proof, but they help (at the start of the conversation, at least).

Re:I believe there are entire companies right now under AI p... by BoneShard on Friday May 15, 2026 @07:30PM (#48155275)
We're trying to outsmart The Genie(a Jinn) now. He will deliver according to the letter of the prompt but not the spirit of it.
Re:I believe there are entire companies right now under AI p... by topaz0 on Saturday May 16, 2026 @01:59PM (#48162351)
Just add "do what I'm intending to ask, not what I actually asked" and it'll be fine.

Works on genies too, or so I'm told by Clod.

Re:I believe there are entire companies right now under AI p... by XenophileJKO on Friday May 15, 2026 @11:15PM (#48156521)
I've found just asking it to be "critical but constructive", goes a long long way.
Re:I believe there are entire companies right now under AI p... by skydhash on Saturday May 16, 2026 @01:37AM (#48157136)
> Treat my claims as hypotheses, not decisions. Before agreeing with a proposed change, state the strongest case against it. [...]Say hard things plainly, then soften if needed — not the other way around. For drafting, brainstorming, or casual questions, ease off and match the task.

All I really take from this is that apparently some people can't follow through with the scientific method.

People who I interact with and who do like AI tools usually recoils at questioning any of their first idea and its validity. You can easily find out when there is a bug and you ask them for hypothesis and where to focus. You will see in real time the blank look of incomprehension settling in.

Re:I believe there are entire companies right now under AI p... by mitjam on Friday May 15, 2026 @05:48PM (#48154352)
For a start, invert - ask about the exact opposite in a separate session.
Re:I believe there are entire companies right now under AI p... by onjectic on Saturday May 16, 2026 @03:50AM (#48157844)
I’ll second this. Great way to recalibrate yourself, once you see it confidently assert the exact opposite statement.