Re:Numbers every LLM Developer should know
by renonce on Thursday May 18, 2023 @01:24AM
(#35984394)
Only if you use gpt-4. gpt-3.5-turbo is much faster, and gpt-4 is only going to get faster as GPUs get faster.
[ Parent
| on HN ]
Bing also uses GPT-4 and it is very fast. Microsoft spends more ok compute.
Re:Numbers every LLM Developer should know
by furyofantares on Thursday May 18, 2023 @10:38AM
(#35988613)
It doesn't exclusively use GPT-4, you might be right anyway that their GPT-4 is much faster but you're also not always seeing GPT-4 with them.
I'm pretty sure it at least mostly uses GPT-4.
Re:Numbers every LLM Developer should know
by darknoon on Thursday May 18, 2023 @08:31PM
(#35996306)
afaict OpenAI's instance is massively overloaded, you can see with the 32k context model actually being faster in practice rather than slower
Re:Numbers every LLM Developer should know
by furyofantares on Thursday May 18, 2023 @10:37AM
(#35988595)
Yep. I use GPT-4 extensively and exclusively, and the comment I was replying to mentioned GPT-4. I can't wait for it to get faster.