News for hackers. Stuff that matters.
Re:Show HN: Pest – Fast parser generator written in Rust by OtterCoder on Sunday August 27, 2017 @01:45PM (#15111753)
I remember playing with PEGjs back in the day, making a toy implementation of JS in JS. It had terrible Unicode support though. To build a token out of valid Unicode non-whitespace characters took pages and pages of range definitions. Is that any better here?
Re:Show HN: Pest – Fast parser generator written in Rust by runevault on Sunday August 27, 2017 @01:55PM (#15111811)
Rust by default uses Unicode for strings. I would be surprised if this had problems with them.
Re:Show HN: Pest – Fast parser generator written in Rust by OtterCoder on Sunday August 27, 2017 @01:59PM (#15111832)
The difficulty wasn't in the engine. JS itself is just as good with accepting Unicode characters as Rust, both in code and strings. The problem was with the PEG implementation. Without some sort of shorthand for Unicode families, defining programming languages that are valid in multiple real-world languages becomes a serious burden.
Re:Show HN: Pest – Fast parser generator written in Rust by yellowapple on Sunday August 27, 2017 @03:41PM (#15112319)
This is one of the things Perl 6 does really well,).