[jmgrosen]

Some of you may enjoy this fantastic recent paper on how to win both the comprehension benefits of splitting lexer and parser AND the performance benefits of fusing them: https://www.cl.cam.ac.uk/~jdy22/papers/flap-a-deterministic-...

[e4m2]

There is an extended version on arXiv: https://arxiv.org/abs/2304.05276.

Also, the artifact (Docker image + some guides, CC BY 4.0) for the OCaml library: https://zenodo.org/record/7824835.

Edit: The opam file actually says the license is MIT. I'd be more inclined to believe that over CC BY 4.0 as far as source code licensing goes.

[ThatGeoGuy]

In addition to this, I always think about Matt Might's "Parsing with Derivatives." [1]

I'll have to read about flap, as it seems to utilize a lexer based on derivatives.

[1]: https://www.youtube.com/watch?v=ZzsK8Am6dKU

[ratmice]

Matt Might also did an article about lexing with regex derivatives.

https://matt.might.net/articles/nonblocking-lexing-toolkit-b...