News for hackers. Stuff that matters.
Re:Show HN: Faster UTF-8 validator by thechao on Friday November 15, 2019 @08:55PM (#21550456)
How much faster than a "naive" scalar implementation is this?
Re:Show HN: Faster UTF-8 validator by zwegner on Friday November 15, 2019 @10:48PM (#21550872)
It depends on the implementation. A good starting point would be looking at the various implementations benchmarked here: https://github.com/lemire/fastvalidate-utf-8

It looks like the main naive validator there (validate_utf8) clocks in at 1.25 cycles/byte for ASCII and 11 cycles/byte for UTF-8, which is respectively a 15.8x and 41.5x slowdown from my code.