News for hackers. Stuff that matters.
Re:The Waluigi Effect: an explanation of bizarre semiotic ef... by jefftk on Monday March 06, 2023 @04:17PM (#35047735)
> There is no evidence given that we are seeing more Waluiginess post-RLHF than we did pre-RLHF.

Testing with the non-RLHF GPT 3.5 API you could probably figure out whether there's more or less Waluiginess, but you're right they post doesn't present this.

Re:The Waluigi Effect: an explanation of bizarre semiotic ef... by dragonwriter on Monday March 06, 2023 @04:45PM (#35048101)
> Testing with the non-RLHF GPT 3.5 API

There is no such API, though, is there? AFAIK, GPT-3.5-turbo, either the updated or snapshot version, is the RLHF model (but bring your own “system prompt”.)

Re:The Waluigi Effect: an explanation of bizarre semiotic ef... by jefftk on Monday March 06, 2023 @08:09PM (#35050181)
Good point! I wonder whether text-davinci-003 is enough to test this?