Re:Ask HN: How do AI chatbots develop personalities?
by Timon3 on Friday February 17, 2023 @04:56AM
(#34832810)
Can you expand on what further randomness is supposedly injected? Every single AI system which I have used has supported seeding, and seeding made very single one deterministic. I honestly don't know how you're supposed to have "randomness" in AI models if the RNG is seeded.
It's a different story if you use specific libraries like Xformers, but those introduce randomness as an artifact of their optimizations, not due to any magical non-seeded randomness.
Certain applications have different levels of randomness, but the chatbots are usually put on higher levels of randomness, especially the entertainment ones.
You can make something that produces the same output every time. This is more commonly used for code autocompletes. So if you try to chat with Copilot, you'll likely get something more deterministic.
ChatGPT is probably toned down more than most, to avoid it from going off the rails. It is a bit sad that the AI most people have access too is rather "caged". The "jailbreak" techniques actually show AI closer to what it's like. Saying ChatGPT is deterministic is similar to saying a human in a call center is deterministic; they're following a SOP but that's not what they're really like.