News for hackers. Stuff that matters.

A comment on Tell HN: A 8000 tokens long chat with GPT-4 can cost more than $5 using the API. Parent comment

Re:Tell HN: A 8000 tokens long chat with GPT-4 can cost more... by BeenAGoodUser on Thursday March 16, 2023 @11:36PM (#35192700)
I hope it's just that and the costs quickly go down. Seeing the cost of gpt-3.5-turbo, and since many rumors have stated that GPT-4 isn't much larger than GPT-3.5, I wasn't expecting such a high price.
[ Parent | on HN ]
Re:Tell HN: A 8000 tokens long chat with GPT-4 can cost more... by verdverm on Friday March 17, 2023 @01:27AM (#35193496)
It's not the size of the GPT, but the magic in it that makes the difference....

Could be that while the number of parameters are not significantly more, they could be doing more computation per token.

[ Parent | on HN ]