News for hackers. Stuff that matters.

A comment on AI Models Like GPT-4o Change Without Warning. Here's What You Can Do About It.

Re:AI Models Like GPT-4o Change Without Warning. Here's What... by Terr_ on Wednesday February 19, 2025 @03:35PM (#43107308)
> On top of all the other things that add uncertainty to our software (flaky servers, third-party APIs going down, scaling issues),

Plus the elephant in the room, that prompt injection and hallucinations are a fundamental way of life for the algorithm, even when it's not getting updated in the background.

[ Parent | on HN ]
Re:AI Models Like GPT-4o Change Without Warning. Here's What... by aickin on Wednesday February 19, 2025 @04:17PM (#43107803)
Yep, that's also a huge issue with LLMs in production. Our product has some automatic detection of jailbreak attempts so that you can see when people are trying to jailbreak & prompt inject, but hallucinations are the biggest unsolved problem imo.
[ Parent | on HN ]