News for hackers. Stuff that matters.

A comment on Extracting Training Data from ChatGPT. Parent comment

Re:Extracting Training Data from ChatGPT by munro on Wednesday November 29, 2023 @12:50PM (#38462592)
I think the exploit would be training on ChatGPT users' chat history.

> Chat history & training > Save new chats on this browser to your history and allow them to be used to improve our models. Unsaved chats will be deleted from our systems within 30 days. This setting does not sync across browsers or devices. Learn more

[ Parent | on HN ]
Re:Extracting Training Data from ChatGPT by bonzaidrinkingb on Wednesday November 29, 2023 @01:02PM (#38462782)
If ChatGPT ever outputs other user's chat history, the company is as good as dead. If that could be exploited using this technique that is out in the wild for over a year: show me the data.
[ Parent | on HN ]
Re:Extracting Training Data from ChatGPT by whywhywhywhy on Wednesday November 29, 2023 @01:10PM (#38462882)
Already has, https://www.bbc.co.uk/news/technology-65047304
[ Parent | on HN ]
Re:Extracting Training Data from ChatGPT by timfsu on Wednesday November 29, 2023 @01:23PM (#38463057)
That was a regular frontend bug though, not an issue with the LLM
[ Parent | on HN ]
Re:Extracting Training Data from ChatGPT by Jensson on Wednesday November 29, 2023 @01:50PM (#38463474)
It is an issue with the company though. I saw that as well. The point is that leaking user data doesn't destroy startups, it barely even hurts well established companies.
[ Parent | on HN ]
Re:Extracting Training Data from ChatGPT by zer0c00ler on Thursday November 30, 2023 @08:19AM (#38473108)
Read OpenAI's response to this security issue carefully - it tells you a lot about how they think of being responsible for issues like this. I remember they put all the blame on the open source library, rather than taking responsibility themselves.
[ Parent | on HN ]