Re:Google is freaking out about ChatGPT
by otabdeveloper4 on Monday January 23, 2023 @04:14AM
(#34486901)
"Query" is ambiguous, because ChatGPT runs on "tokens", not "queries".
In real life you will want an order of magnitude more tokens if you're generating something useful and not just testing/playing.
Compute doesn't get cheaper over time, it gets more expensive. This isn't 1993 anymore.
Re:Google is freaking out about ChatGPT
by funstuff007 on Monday January 23, 2023 @08:31AM
(#34488500)
It's only getting more expensive because we've let AWS, Google Cloud, and Azure own all the machines.
> but high enough that I don't ever see regular humans pay for it for day-to-day tasks.
And “640K ought to be enough for anyone”.
Of course this will get cheaper over time as compute gets cheaper and the cloud providers design custom chips optimized for it.