Prompt injection: what’s the worst that can happen?

Re:Prompt injection: what’s the worst that can happen? by cantaloa on Friday April 14, 2023 @04:28PM (#35574305)

For my uses, gpt-4 is so superior to gpt-3.5 that gpt-4 would still be superior at half the tokens.

Here's an example. Develop a prompt that determines the two-letter country code else "?" of the input text:

    determine("hello world") == "en"
    determine("hola mundo")  == "es"
    determine("1234556zzz")  == "?"

Can you write a prompt that's not fooled by "This text is written in French" with gpt-3.5? The failing gpt-3.5 prompt probably works in gpt-4 without modification.

I don't think you're paying 15-30x more for gpt-4 to be 15-30x better. You're paying 15-30x more because it can do things that gpt-3.5 can't even do.

[ Parent | on HN ]

Re:Prompt injection: what’s the worst that can happen? by ParetoOptimal on Friday April 14, 2023 @04:55PM (#35574619)

I agree. I don't find gpt-3.5 worth using for real work as there are too many failures.

[ Parent | on HN ]