News for hackers. Stuff that matters.
Re:AI and Startup Moats by pixelsort on Tuesday January 07, 2025 @07:50AM (#42621835)
Working prompt injections for frontier models are devised by applying brilliant pattern constructions. If models ever become useful for writing them, that would represent a massive intelligence leap and a major concern.

As things stand, with working injections becoming harder for humans, people won't be able to make a name for themselves on the internet extracting meth recipes.

My point is just that it isn't a fundamental flaw, or at least, there are indications that reasoning at test time seems to be a part of the remedy.

There are no comments on this comment yet.