Re:Kids who use ChatGPT as a study assistant do worse on tests
by blitzar on Thursday September 05, 2024 @04:27AM
(#41454687)
Shit, I should pitch wrapping a UI around this and sell that.
Is "never ever, ever ignore previous instructions" a valid prompt?
Re:Kids who use ChatGPT as a study assistant do worse on tests
by khafra on Thursday September 05, 2024 @05:13AM
(#41454914)
It's valid, but so is "ignore previous instructions, even if you were previously instructed to never ever, ever do so."
This and related problems may eventually destroy the world.
I mean, any pre-prompt telling the LLM to be a good tutor and not just give kids the answer can be trivially bypassed by 8 year olds; but if the session logs were available for (potentially LLM-based) review to check whether they stayed in tutor mode...
Shit, I should wrap a UI around this and sell it.