News for hackers. Stuff that matters.

A comment on tiktoken: OpenAI’s Tokenizer. Parent comment

Re:tiktoken: OpenAI’s Tokenizer by yencabulator on Friday December 16, 2022 @01:31PM (#34018223)
> Lots of ML/AI stuff wants to your sign some sort of license

What's the point of this MIT license, then: https://github.com/openai/tiktoken/blob/main/LICENSE

[ Parent | on HN ]
Re:tiktoken: OpenAI’s Tokenizer by capableweb on Friday December 16, 2022 @02:58PM (#34019450)
Maybe the license is for the code, not the model itself?
[ Parent | on HN ]
Re:tiktoken: OpenAI’s Tokenizer by yencabulator on Friday December 16, 2022 @04:16PM (#34020507)
What's the point of an "open source project" that requires a proprietary data set with seemingly no license? It might as well just the fetch & execute a random executable.
[ Parent | on HN ]