News for hackers. Stuff that matters.
Re:Meta's prompt guard defeated using spaces by IEatPrompts on Wednesday July 31, 2024 @05:24AM (#41117591)
Meta's new prompt-guard-86M normally flags almost everything as a jailbreak, but apparently spacing out letters makes it see prompts as harmless. Pretty weird way they found this - instead of hammering it with jailbreaks, they just compared embedding weights with the non fine-tuned model.

There are no comments on this comment yet.