News for hackers. Stuff that matters.

A comment on The Super Tiny Compiler. Parent comment

Re:The Super Tiny Compiler by deterministic on Friday March 03, 2023 @09:00PM (#35017386)
I am a professional compiler writer and nope you are wrong. I never tokenise everything up front and instead read tokens on demand. It is much faster and enables me to change how tokens are interpreted on the fly. Which enables me to parse different languages with different token definitions in the same file. Something that I need for the production work I do.
[ Parent | on HN ]
Re:The Super Tiny Compiler by bmn__ on Saturday March 04, 2023 @11:04AM (#35021795)
>>> when is it useful, if ever, to tokenize the whole input beforehand

>> never

> nope you are wrong. I never tokenise everything up front

Explain how you could possibly arrive at the complete opposite meaning of what I wrote when you even use the same word "never" as I did?

Quick, get another downvote in, that'll teach me! Peak HN moment here.

[ Parent | on HN ]
Re:The Super Tiny Compiler by deterministic on Saturday March 04, 2023 @09:52PM (#35026534)
Sorry I clearly misunderstood your point. My bad.

I upvoted your correction.

[ Parent | on HN ]