Re:Transcoding Unicode with AVX-512: AMD Zen 4 vs. Intel Ice...
by qalmakka on Sunday January 08, 2023 @10:24AM
(#34299820)
This, it's pointless to have char32_t if you still need to pull several megabytes of ICU to normalize the string first in order to remove characters spanning over multiple codepoints. UTF32 is arguably dangerous because of this, it's yet another attempt to replicate ASCII but with Unicode. The only sane encoding out there is UTF-8, and that's it. If you have to always assume your string is not really splittable without a library, you won't do dangerous stuff such as assuming `wcslen(L"menù") == 4`.
[ Parent
| on HN ]
There are no comments on this comment yet.