News for hackers. Stuff that matters.
Re:Major Outage Across ChatGPT and API by lopatin on Wednesday November 08, 2023 @12:29PM (#38193816)
I used it for the first time today too, for the same reason. It was slower and much worse at coding. I was just asking it for SQL aggregation queries and it just ignored some of my requirements for the query.
Re:Major Outage Across ChatGPT and API by tompetry on Wednesday November 08, 2023 @12:38PM (#38193971)
I have seen noticably worse results with Bard, especially with long prompts. Claude (by Anthropic) has been my backup to ChatGPT.
Re:Major Outage Across ChatGPT and API by tombert on Wednesday November 08, 2023 @12:44PM (#38194053)
In my case, I was just asking it for a cheeky name for a talk I want to give in a few months. The suggestions it gave were of comparable quality to what I think ChatGPT would have given me.
Re:Major Outage Across ChatGPT and API by Tommstein on Wednesday November 08, 2023 @04:52PM (#38197621)
In my experience, Bard is much, much better at creative things than at things that have correct and incorrect answers.
Re:Major Outage Across ChatGPT and API by nomel on Wednesday November 08, 2023 @11:28PM (#38201192)
I subscribe to the belief that, for a chat model with the same parameters, creativity will be proportional to tendency to hallucinate, and inversely proportional to the factual answers. I suspect an unaligned model, without RLHF, wouldn't adhere to this.
Re:Major Outage Across ChatGPT and API by Filligree on Wednesday November 08, 2023 @04:58PM (#38197711)
ChatGPT was down, so of course it'd be slower. And possibly that accounts for some quality loss as well.

For a fair comparison, you probably need to try while ChatGPT is working.

Re:Major Outage Across ChatGPT and API by IanCal on Wednesday November 08, 2023 @05:45PM (#38198312)
The extension with gpt4 as a backend was ime extremely slow as standard. I've not tried it again with the v7 model though which is supposed to be a lot faster
Re:Major Outage Across ChatGPT and API by willsmith72 on Wednesday November 08, 2023 @07:47PM (#38199411)
> ChatGPT was down, so of course it'd be slower

Actually at Google scale I wouldn't expect so

Re:Major Outage Across ChatGPT and API by kccqzy on Wednesday November 08, 2023 @08:25PM (#38199728)
Yeah but Google missed the boat when it came to hardware accelerators specifically meant for LLMs (their proprietary TPUs aren't optimized for LLMs) so it's just a matter of whether Google or Microsoft paid Nvidia more. In the current cost cutting climate at Google I doubt the answer is so certain.
Re:Major Outage Across ChatGPT and API by fennecfoxy on Thursday November 09, 2023 @06:28AM (#38203681)
Idk I think there's a bit of a difference between a session for some basic website vs machine learning stuff. The base perf cost per user is muuuuuch higher for ML.
Re:Major Outage Across ChatGPT and API by felarof on Thursday November 09, 2023 @11:36PM (#38215088)
[creator here] You can download https://www.oppenheimer.app to use Bard and ChatGPT side-by-side!