News for hackers. Stuff that matters.
Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by flimflamm on Thursday November 14, 2024 @03:34PM (#42140906)
Why everything you see isn't just hallucinated?
Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by Kuinox on Thursday November 14, 2024 @04:01PM (#42141173)
ChatGPT doesn't imagine running code, it actually runs the code, you can see the code it write and some of the output of what it runs, you can see it in the interface screenshoted in the article.
Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by flimflamm on Sunday November 17, 2024 @06:12AM (#42163463)
Yeah I know it runs. But it also hallucinated a Shell: https://www.reddit.com/r/ChatGPT/comments/ziukmm/i_asked_it_...
Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by Kuinox on Monday November 18, 2024 @04:26PM (#42177238)
Yes, it's well known. But chatgpt cannot fake the output of the python tool. The UI is different and is purely the program output, ChatGPT doesn't have a say in that.
Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by marcofigueroa on Thursday November 14, 2024 @04:47PM (#42141581)
Good question, we at 0Din have trace down hallucinations. We had to because we pay for LLM bugs. Here is a simple tell, if you prompt something specific look at a response window now use the same prompt with a completely different user account if the answer is 50% the same it is not a hallucination!
Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by flimflamm on Sunday November 17, 2024 @06:14AM (#42163472)
How is different user account usage and partial similar answer preventing an answer being hallucinated? Are you saying that ChatGPT could not (or LLMs in genera) hallucinate consistently?