News for hackers. Stuff that matters.
Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by simonw on Thursday November 14, 2024 @03:24PM (#42140781)
The system underlying all of this - ChatGPT Code Interpreter - is designed to allow users to execute code, including code that lists files and folders and allows files to be downloaded.

There's not much in here that feels like a security vulnerability to me.

The one exception is the thing where you can download files from GPTs. If you create a custom GPT with files in it those files are visible in the /data directory that is visible to Code Interpreter, which means users can request ChatGPT to zip them up and allow you to download that zip file.

This is a known issue which I've seen people complaining about before, and I'm a little surprised that OpenAI haven't addressed it.

It makes sense for files uploaded to a GPT to be visible to Code Interpreter in some cases - my own JavaScript Code Interpreter - https://simonwillison.net/2023/Nov/15/gpts/#javascript-code-... - bundles a Deno binary so Python can shell out to it and run JavaScript, for example.

But if you're uploading files to have them chunked and embedded and used for RAG you might not want the raw PDFs to be available in Code Interpreter as well.

One solution would be for GPTs to allow you to specify if each file should be used for RAG or Code Interpreter or both when you upload them.

GPTs haven't had much developer attention since they launched last year though.

I've been running a scraper against Code Interpreter for a while to track changes made to both the internal code and the available packages - you can see that here: https://github.com/simonw/scrape-openai-code-interpreter

Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by marcofigueroa on Thursday November 14, 2024 @04:43PM (#42141550)
Well in my opinion it is a design flaw, you can do a lot in that container that I wish I could publish and the blog for me was hoping to inform researchers to open themselves to the possibilities of what they could really do.
Re:Prompt Injecting Your Way to Shell: OpenAI's Containerize... by MeetingsBrowser on Thursday November 14, 2024 @06:23PM (#42142368)
Why can you not publish the interesting parts? Is it something you will be able to publish later?