News for hackers. Stuff that matters.
Re:Why is GPT-3 15.77x more expensive for certain languages? by tough on Monday April 10, 2023 @03:47PM (#35516561)
I just found this tiktokenizer project in GH that might be of help to you https://tiktokenizer.vercel.app/

There are no comments on this comment yet.