News for hackers. Stuff that matters.
Re:Latest ChatGPT 4 System prompt (1,700 tokens) by kevingadd on Wednesday February 07, 2024 @02:54PM (#39293402)
There's already a viewpoint encoded into the model during training (from its training set), the prompt is just another part of that. The prompt makes you upset because you can "see" the viewpoint encoded into it, but even if this prompt was gone there would still be a bunch of bias baked into the model.
Re:Latest ChatGPT 4 System prompt (1,700 tokens) by vessenes on Wednesday February 07, 2024 @05:06PM (#39294914)
Oh absolutely; the foundation model and the human preference tuning have a mix of intentional, unintentional, based-in-reality, and based-in-reddit-comment-reality bias; that's unavoidable. What's totally avoidable is making a world in which people are "debiased" based on hidden instructions.