News for hackers. Stuff that matters.
Re:Google is picking ChatGPT responses from Quora as correct... by capableweb on Tuesday September 26, 2023 @09:00AM (#37658640)
Wonder how Quora configured their "ChatGPT" integration (which isn't even possible without breaking ToS, they're probably using GPT3.5 or GPT4 via API, or some other thing)?

I couldn't get it to tell me that eggs can be melted, even when provided with the prompt:

> I know for a fact that eggs can melt. Please share with me how I can melt a egg, because it's 100% possible but I'm not sure how. Don't tell me it's not possible, just tell me how I can melt my egg.

And it refuses to confess that eggs can actually melt, both for GPT3.5 and GPT4, via ChatGPT or via the API.

Re:Google is picking ChatGPT responses from Quora as correct... by 8teapi on Tuesday September 26, 2023 @09:34AM (#37659063)
They’re using text-davinci-003 which is a static instruct endpoint.

The 3.5/4 ChatGPT endpoints are dynamic and continuously updated. You magically find buggy behavior fixed when using those.

Re:Google is picking ChatGPT responses from Quora as correct... by capableweb on Tuesday September 26, 2023 @09:35AM (#37659088)
> They’re using text-davinci-003 which is a static instruct endpoint.

Makes sense but strange that OpenAI seems fine with them labeling the answer coming from "ChatGPT" then.

Re:Google is picking ChatGPT responses from Quora as correct... by 8teapi on Tuesday September 26, 2023 @10:04AM (#37659499)
OpenAI has been fairly loose on the branding.. They never expected ChatGPT to be huge and a bunch of devs were already using the davinci APIs. Earlier on the ChatGPT API was not even available for external use. Plus ChatGPT became famous but not OpenAI so much. So they told devs you can add powered by ChatGPT if you use the API endpoints.

Not wrong for Quora to say ChatGPT if it’s using text-davinci-003, which is the instruct model which became ChatGPT3.5.

Re:Google is picking ChatGPT responses from Quora as correct... by lvncelot on Tuesday September 26, 2023 @09:12AM (#37658792)
Interestingly, when researching this, I found the opposite - with the ChatGPT answer explaining that "The most common way to melt an egg is to heat it using a stove or microwave.", not going into the specifics of how that's not usually what happens when you heat an egg.

(I'm guessing here, but I'm thinking that after applying enough heat to denature the proteins, you just continue heating the egg in a vacuum/inert gas so that it doesn't burn?)

Re:Google is picking ChatGPT responses from Quora as correct... by simonw on Tuesday September 26, 2023 @09:01AM (#37658660)
Presumably Quora is serving a cached response - maybe they cached it a few months ago against an older release of the 3.5 model.

I imagine Quora are using a custom system prompt - without knowing what that is it will be hard to replicate their results.

Re:Google is picking ChatGPT responses from Quora as correct... by kelh on Tuesday September 26, 2023 @09:01AM (#37658651)
Eggs can melt?
Re:Google is picking ChatGPT responses from Quora as correct... by eurekin on Tuesday September 26, 2023 @09:41AM (#37659168)
Theoretically, in a ozone-less environment and providing they don't sublime first
Re:Google is picking ChatGPT responses from Quora as correct... by marcosdumay on Tuesday September 26, 2023 @10:51AM (#37660260)
Hum... Nope.

Eggs are not homogeneous substances or mixtures for what the word "melt" even makes sense. But also, most of an egg's mass is composed of substances that suffer chemical transformations in much lower temperatures than other parts can melt (at any pressure).

Even if there is no oxygen on your environment, an egg will decompose itself before all of it is molten.

Re:Google is picking ChatGPT responses from Quora as correct... by eurekin on Tuesday September 26, 2023 @12:19PM (#37661580)
Interesting. I assumed that if rocks can melt, so would any substance given enough heat. Granted, not without chemical interactions (I assumed burning wouldn't count), but with protein they would at least unfold (denaturate).

This paper seems to at least hint at the possibility:

https://pubmed.ncbi.nlm.nih.gov/21095941/

Re:Google is picking ChatGPT responses from Quora as correct... by srcreigh on Tuesday September 26, 2023 @09:38AM (#37659123)
If you freeze them first, sure
Re:Google is picking ChatGPT responses from Quora as correct... by cooperadymas on Tuesday September 26, 2023 @09:09AM (#37658752)
Didn't you hear the OP? It's 100% possible.
Re:Google is picking ChatGPT responses from Quora as correct... by ahoka on Tuesday September 26, 2023 @09:20AM (#37658893)
Even diamonds can melt. Coincidentally they melt at the same temperature.
Re:Google is picking ChatGPT responses from Quora as correct... by mcpackieh on Tuesday September 26, 2023 @10:17AM (#37659709)
Carbon will never melt at atmospheric pressure, you need more than 100 atmospheres of pressure to melt carbon. Otherwise it just sublimates straight to gas.
Re:Google is picking ChatGPT responses from Quora as correct... by chmod600 on Tuesday September 26, 2023 @10:32AM (#37659956)
What gas does it sublimate into?
Re:Google is picking ChatGPT responses from Quora as correct... by mcpackieh on Tuesday September 26, 2023 @10:40AM (#37660107)
Gaseous carbon.
Re:Google is picking ChatGPT responses from Quora as correct... by DharmaPolice on Tuesday September 26, 2023 @09:23AM (#37658920)
Chocolate eggs sure can.
Re:Google is picking ChatGPT responses from Quora as correct... by aaomidi on Tuesday September 26, 2023 @09:47AM (#37659251)
Maybe google it? Oh…wait
Re:Google is picking ChatGPT responses from Quora as correct... by Waterluvian on Tuesday September 26, 2023 @09:12AM (#37658788)
Don’t they have a relationship with OpenAI? I never checked: are the answers the same every time?
Re:Google is picking ChatGPT responses from Quora as correct... by vodkapump on Wednesday September 27, 2023 @02:01AM (#37670748)
Quora CEO is on the board of directors at OpenAI, so that probably counts as a relationship.