News for hackers. Stuff that matters.
Re:Building LLM Applications for Production by pabl8k on Friday April 14, 2023 @10:58AM (#35570264)
And possibly even if you do understand it! It seems like it might be a fundamentally intractable problem with LLMs, even if it can be made more difficult to do, no?
Re:Building LLM Applications for Production by simonw on Friday April 14, 2023 @11:10AM (#35570404)
Yes, exactly: right now I still haven't seen a convincing reliable mitigation for a prompt injection attack.

Which means there are entire categories of applications - including things like personal assistants that can both read and reply to your emails - that may be impossible to safely build at the moment.