News for hackers. Stuff that matters.
Re:Enough AI Copilots, We Need AI HUDs by vidarh on Monday July 28, 2025 @05:09AM (#44708838)
You could prune this drastically by just tokenizing the file with a lexer suitable for the language, turn them into a canonical state (e.g. replace the contents of any comment tokens with identical text), and check if the token state has changed. If you have a restartable lexer, you can even re-tokenize only from the current line until the state converges again or you encounter a syntax error.

There are no comments on this comment yet.