News for hackers. Stuff that matters.

A comment on It looks like GPT-4-32k is rolling out. Parent comment

Re:It looks like GPT-4-32k is rolling out by fbrncci on Saturday May 06, 2023 @07:01PM (#35846139)
Even if it was around 0.10$. This does not scale, it would need to be less than 0.01$ per generation to keep up with open source models where the cost effectively is 0$ (leaving our hardware).
[ Parent | on HN ]
Re:It looks like GPT-4-32k is rolling out by raincole on Sunday May 07, 2023 @08:12AM (#35850575)
Oh really. Then show me your "open source model" that handles 32k tokens on a consumer-grade PC. Actually don't show me, show the internet. You will be the most famous man in tech world.
[ Parent | on HN ]
Re:It looks like GPT-4-32k is rolling out by fbrncci on Sunday May 07, 2023 @08:34AM (#35850801)
Well surely I can't convince you, feel free to build the next AI startup on OpenAI then, and stop caring about any possible competition out scaling you once token limits on open source models become more in line with the walled garden of Google, MS and OpenAI's high API pricing ;)
[ Parent | on HN ]
Re:It looks like GPT-4-32k is rolling out by raincole on Sunday May 07, 2023 @10:01AM (#35851611)
My bet is open source models (true open source without string attached) won't ever catch up OpenAI etc. I'll be really surprised if there is one that can match GPT-4 in the next 2~3 years. If you tried LLaMA and StableLM you would probably feel the same.
[ Parent | on HN ]