I’ve seen it do this even for things that are so niche that it couldn’t possibly have been fine-tuned manually (it was unrelated to anything political). It must develop some sort of sense of what’s a reasonable/wise perspective and then stick to that. Like what a human would do.

But I think it’s a bias to safety and politeness. …which is pretty reasonable? “Hey, this is how to make a gun!” …is a fast track to getting sued.

> I’ve seen it do this even for things that are so niche that it couldn’t possibly have been fine-tuned manually (it was unrelated to anything political).

It is worth noting that one of OpenAI’s public product is a moderation classifier running its own (continuously updated) model and providing scores in various “objectionable content” categories; it’s possible they are using something like a more advanced version of this to determine whether, and what kind, of “I won’t respond because…” answer to use, rather than something relying only on manual identification of particularly narrow content.

That sounds exactly like what is going on. Are there specific ways of prompting it that can let you manipulate that moderation classifier?

(I almost think half of the point of opening up CharGPT like this is to flex the fact that they can prevent it from being Milkshake Ducked by the usual level of cherrypicking and malevolent use.)

Why would gun making instructions get you sued?

They want to deploy this tech to, like, high schools.

Does Google censor searches for gun making from high schools? If not, have they gotten sued?

I can assure you that “SafeSearch” is enabled on school computers.

Does SafeSearch block results about making guns, though? I just did a quick test of it and it didn't seem to.