News for hackers. Stuff that matters.

A comment on GPT-3 pricing for API usage announced to beta users to go in effect from October.

Re:GPT-3 pricing for API usage announced to beta users to go... by dgellow on Thursday September 03, 2020 @05:49AM (#24362384)
Could someone clarify what exactly are those tokens ?
[ Parent | on HN ]
Re:GPT-3 pricing for API usage announced to beta users to go... by winchester6788 on Thursday September 03, 2020 @06:32AM (#24362617)
Length of given text after encoding it with their BPE. In general, you can expect it to be 1.2x-2x the len(words) in your text.
[ Parent | on HN ]
Re:GPT-3 pricing for API usage announced to beta users to go... by minimaxir on Thursday September 03, 2020 @12:25PM (#24365657)
The Pricing FAQ notes that it's, on average, 4 characters, which IMO is fair.

Super common punctuation is its own token, however.

[ Parent | on HN ]