News for hackers. Stuff that matters.
Re:Why Split Lexing and Parsing into Two Separate Phases? by jmgrosen on Thursday May 04, 2023 @12:05PM (#35817638)
Some of you may enjoy this fantastic recent paper on how to win both the comprehension benefits of splitting lexer and parser AND the performance benefits of fusing them: https://www.cl.cam.ac.uk/~jdy22/papers/flap-a-deterministic-...
Re:Why Split Lexing and Parsing into Two Separate Phases? by e4m2 on Thursday May 04, 2023 @12:20PM (#35817898)
There is an extended version on arXiv: https://arxiv.org/abs/2304.05276.

Also, the artifact (Docker image + some guides, CC BY 4.0) for the OCaml library: https://zenodo.org/record/7824835.

Re:Why Split Lexing and Parsing into Two Separate Phases? by ThatGeoGuy on Thursday May 04, 2023 @12:43PM (#35818308)
In addition to this, I always think about Matt Might's "Parsing with Derivatives." [1]

I'll have to read about flap, as it seems to utilize a lexer based on derivatives.

[1]: https://www.youtube.com/watch?v=ZzsK8Am6dKU

Re:Why Split Lexing and Parsing into Two Separate Phases? by ratmice on Thursday May 04, 2023 @04:32PM (#35821668)
Matt Might also did an article about lexing with regex derivatives.

https://matt.might.net/articles/nonblocking-lexing-toolkit-b...