GPT4 hallucinating a FTP server at ftp.disney.com

Re:GPT4 hallucinating a FTP server at ftp.disney.com by PeterStuer on Wednesday April 05, 2023 @03:25AM (#35450556)

In 3.5 days I had it "hallucinate" you could share documents with it via Google Drive.

Transcript:

Can I give you a document and ask for a summary?

Yes, you can give me a document and ask for a summary. However, please note that as an AI language model, my ability to summarize a document may depend on the length and complexity of the document, as well as the quality and clarity of the writing. Additionally, please be aware that I am an automated system and may not always capture the main points or nuances of a document as accurately as a human reader.

How do I give you the document?

You can provide me with the document by copying and pasting the text into our conversation. Alternatively, you can upload the document to a cloud storage service such as Google Drive or Dropbox, and then share the link with me so that I can access and read the document. Please note that I will only be able to access public documents or those for which you provide me with appropriate access.

How do I share a document on a google drive with you?

To share a document on Google Drive with me, please follow these steps:

    1. Upload the document to your Google Drive account.
    2. Right-click on the document and select "Share" from the dropdown menu.
    3. In the "Share with people and groups" box, type "[email protected]" to add me as a collaborator.
    4, Choose the appropriate sharing settings (e.g., "Can edit," "Can comment," or "Can view") for the document.
    5. Click "Send" to share the document with me.

Once you have shared the document, I will be able to access it and provide a summary if you request it.

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by ummonk on Wednesday April 05, 2023 @03:47AM (#35450728)

Did it work though?

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by PeterStuer on Wednesday April 05, 2023 @08:29AM (#35452971)

No. I did try it immediately at the time of course:

I have uploaded a document for you to summarize https://drive.google.com/file/d/...(redacted)

I'm sorry, but as an AI language model, I do not have access to external sources or links. In order for me to summarize the document, please copy and paste the text of the document into our conversation.

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by quarkw on Wednesday April 05, 2023 @10:28AM (#35454837)

I think it's likely that ChatGPT made up the email address, but what if this is some functionality Open AI has already added, but not enabled, in the system? Or instructed ChatGPT to say that it's unable to access external sources/links when that's not exactly the truth.

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by PeterStuer on Wednesday April 05, 2023 @11:11AM (#35455555)

My take is it would get the general pattern of how to share a file wirh someone on Google Drive, even "inventing" a likely email adress from a pattern, regardless of the presence or absense of the functionality existing, as it has no "knowledge" of the fact.

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by gpderetta on Wednesday April 05, 2023 @03:49AM (#35450739)

Once 3.5 suggested me that there was an upload button by the input box. After spending a few minutes confused not finding it, I asked for clarifications: GPD said it was sorry, it is possible that not all interfaces have this feature and the one I'm using doesn't. It was extremely convincing and to this day I'm still not sure if the, entirely plausible, upload button isn't some premium feature I don't have access to.

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by toxicFork on Wednesday April 05, 2023 @04:12AM (#35450933)

Tbh, with plugins, that's pretty much the case

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by musingsole on Wednesday April 05, 2023 @09:54AM (#35454236)

Whether or not the button exists in someone's interface is likely separate than the means used by GPT to reason it was the case.

GPT responds that there is an upload button because a lot of interfaces are described that way around the web -- there is not likely a hard reference for its answer in regard to its own interface.

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by jon-wood on Wednesday April 05, 2023 @08:55AM (#35453342)

There was a similar incident a while back where someone asked it whether you could make queries via Telegram, and it just handed out a random person's phone number saying they were ChatGPT.

[ Parent | on HN ]

Re:GPT4 hallucinating a FTP server at ftp.disney.com by 93po on Wednesday April 05, 2023 @01:29PM (#35457612)

I experimented a lot with 3.5 and the extent to which it would hallucinate. It was wild. It would argue with me and I'd say something was wrong and ask for its source. It would make up a URL. I would then give it my own URL and then it would start to agree with me based on the website I provided that it couldn't actually access. But sometimes it wouldn't agree, despite my "source", for reasons that didn't make sense. Or sometimes it would agree for reasons that also didn't make sense.

I also had it suggest there was emailing capability in the playground interface, or it would say that it emailed me something I asked for. It would claim to have abilities to do a bunch of stuff like this that it couldn't actually.

Also recently discovered it hallucinates dates and times and has 100% confidence they're correct

[ Parent | on HN ]