News for hackers. Stuff that matters.

A comment on Validating UTF-8 strings using as little as 0.7 cycles per byte. Parent comment

Re:Validating UTF-8 strings using as little as 0.7 cycles pe... by bumblebritches5 on Wednesday May 16, 2018 @02:45PM (#17085255)
Yes, it gives you flexibility in using UTF-8 and UTF-16 (which despite being a shitty format, you WILL have to support UTF-16), and also overlong sequences don't matter.
[ Parent | on HN ]
Re:Validating UTF-8 strings using as little as 0.7 cycles pe... by slrz on Wednesday May 16, 2018 @10:47PM (#17088331)
> which despite being a shitty format, you WILL have to support UTF-16

Luckily not. If you absolutely must deal with legacy encodings, feed them through a conversion pass beforehand.

[ Parent | on HN ]