Re:Major Outage Across ChatGPT and API
by IanCal on Wednesday November 08, 2023 @05:45PM
(#38198312)
The extension with gpt4 as a backend was ime extremely slow as standard. I've not tried it again with the v7 model though which is supposed to be a lot faster
Re:Major Outage Across ChatGPT and API
by willsmith72 on Wednesday November 08, 2023 @07:47PM
(#38199411)
> ChatGPT was down, so of course it'd be slower
Actually at Google scale I wouldn't expect so
Re:Major Outage Across ChatGPT and API
by kccqzy on Wednesday November 08, 2023 @08:25PM
(#38199728)
Yeah but Google missed the boat when it came to hardware accelerators specifically meant for LLMs (their proprietary TPUs aren't optimized for LLMs) so it's just a matter of whether Google or Microsoft paid Nvidia more. In the current cost cutting climate at Google I doubt the answer is so certain.
Re:Major Outage Across ChatGPT and API
by fennecfoxy on Thursday November 09, 2023 @06:28AM
(#38203681)
Idk I think there's a bit of a difference between a session for some basic website vs machine learning stuff. The base perf cost per user is muuuuuch higher for ML.
For a fair comparison, you probably need to try while ChatGPT is working.