News for hackers. Stuff that matters.
Re:OpenAI Tokenizer by lemming on Wednesday April 05, 2023 @09:38PM (#35462995)
Are there plans to release tokenisers for other platforms? I'm accessing the OpenAI API from Clojure, and it would be really nice to have a JVM version so I can estimate token use before sending.

There are no comments on this comment yet.