News for hackers. Stuff that matters.

A comment on tiktoken: OpenAI’s Tokenizer. Parent comment

Re:tiktoken: OpenAI’s Tokenizer by capableweb on Friday December 16, 2022 @02:58PM (#34019450)
Maybe the license is for the code, not the model itself?
[ Parent | on HN ]
Re:tiktoken: OpenAI’s Tokenizer by yencabulator on Friday December 16, 2022 @04:16PM (#34020507)
What's the point of an "open source project" that requires a proprietary data set with seemingly no license? It might as well just the fetch & execute a random executable.
[ Parent | on HN ]