News for hackers. Stuff that matters.
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by matthewmacleod on Thursday June 01, 2023 @05:09PM (#36157370)
It's no coincidence the "free" service is visibly crippled, while paid API users are not reporting any difference.

GPT-4 is not available to free users, which really calls the pretext of this comment into question. What is being alleged to have happened, and why is this response unreasonable?

I’m not a very heavy GPT-4 user but I do usually use it once a day or so - it doesn’t appear to have changed noticeably but I’m not paying close attention.

Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by shmoogy on Thursday June 01, 2023 @05:20PM (#36157497)
ChatGPT4 feels (is?) typically faster, and the results feel ... above 3.5 turbo but below what 4 was. The API seems exactly the same to me, but you cant do an apples to apples test due to variance between replies.

I dont really doubt they scaled the chatGPT4 model down a little to try to save costs with the plugins and increased usage

Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by californical on Thursday June 01, 2023 @06:29PM (#36158302)
Yeah I’m having the same experience. The replies have gotten faster in the last few days, at the expense of quality.

It’s noticeable because I used to be able to read each word as it was printed from the GPt-4 output, but now it goes far too fast for me to keep up with.

Kinda sucks to not have transparency at all into the black box, they’ve strayed so far from “open” at this point that it’s comedic

Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by jstarfish on Thursday June 01, 2023 @06:50PM (#36158516)
It was badly-worded on my part. And I stand corrected-- I just saw all the nested tweets where people are complaining about the API too!

So many people are noticing a degradation in speed and quality of responses, and not in isolation. Rather than acknowledge this, the question is rephrased to one the responder can rightfully deny-- and suggest no changes have taken place without explicitly saying as much. You normally only see this sort of sliminess from politicians and executives on the witness stand.

> Is anyone else noticing significantly downgraded GPT-4 capabilities today? Seems like OpenAI updated the model, and results aren’t as good as before. [mentions API in a child comment]

> The API does not just change without us telling you. The models are static there.

> This is good to know. That means GPT-4 has been static since March right? 0314?

> Correct

Never ask questions to which one word suffices as an answer.

Collective confusion in the thread suggests something has changed, but the most OpenAI will attest to is that the API is unchanged and the models are static. And this may well be true, but rather than admit "...but we were fucking with the middleware/parameters" they took a firm position on a strawman argument and ignored everybody who followed with more-direct questions. Except this guy:

> I've noticed inconsistency with certain prompts performance. Is that just the non-deterministic nature of the API?

> Yes

Oh, ok. It's because the fucking API is non-deterministic that code that has worked both reliably and predictably for everyone now runs like shit for everyone. For fuck's sake, you can get better answers from a Magic 8-Ball. This guy even made the mistake of presenting an answer he'd believe for the respondent to feed into. He might as well have asked if inconsistent performance was because of the war in Ukraine.

"Logan.GPT" must moonlight as a fortune teller. He's only responding to people foolish enough to ask the wrong questions.

Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by avereveard on Thursday June 01, 2023 @08:24PM (#36159286)
And anyway my program used the api with a temperature of zero and it still started acting erratically. They are not telling it straight.
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by TeMPOraL on Thursday June 01, 2023 @09:13PM (#36159601)
> Collective confusion in the thread suggests something has changed, but the most OpenAI will attest to is that the API is unchanged and the models are static. And this may well be true

Here's the thing. Re-read the exchange you quoted:

>> The API does not just change without us telling you. The models are static there.

>> This is good to know. That means GPT-4 has been static since March right? 0314?

>> Correct

Does that "Correct" mean all GPT-4 models have been static since March, or does it only cover the gpt-4-0314, which is a single, specific model? gpt-4-0314 is the static snapshot model, hence 0314 in the name; it exist as a stable base, while gpt-4 was intended to be updated over time.

So I feel OpenAI may be dodging here. That "Correct" may just mean "the gpt-4-0314 model was not updated since March 14", which is, like, the very reason this model exists in the first place.

Important point: if you're using API pay-as-you-go access, unless you wrote the very tools you use with that API, you're most likely using gpt-4, and not gpt-4-0314.

Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by rrrrrrrrrrrryan on Thursday June 01, 2023 @10:45PM (#36160238)
> if you're using API pay-as-you-go access, unless you wrote the very tools you use with that API, you're most likely using gpt-4, and not gpt-4-0314.

Do you know of any alternative ChatGPT UIs like chatbotui.com or typingmind.com that let you specify the model gpt-4-0314 ?

This feature alone would be enough for me to switch.