cantpostcanceld
cantpostcanceld on Hacker News
Re:Infinigen: Infinite Photorealistic Worlds Using Procedural Generation
on Monday December 23, 2024 @04:32AM (#42493087)
The question wasn't "does this use AI". It was, "does any AI use this".
Re:Tokenisation Is NP-Complete
on Monday December 23, 2024 @04:28AM (#42493066)
I don't know if this is related but I work on a project with a language parser and so a tokenizer and one issue we have is the parser/tokenier was not designed to work on incomplete code so it's not useful for auto complete.
That property of how good the design is for helping write and debug (useful error messages) seems like yet another metric that could be used
I also don't know if tokenizers can be divorced from parsers. Some languages have constructs that require context that comes from the parser