News for hackers. Stuff that matters.
Re:Why to normalize Unicode strings by Someone on Wednesday March 13, 2019 @07:39PM (#19385112)
JDK 9 introduced “compact strings” (https://bugs.openjdk.java.net/browse/JDK-8054307). That stores a string’s characters in a byte array, with either the traditional two bytes per ‘char’ (encoding the entire string as UTF16) or, if possible, one (encoding the entire string as ISO-8859-1/Latin-1). They probably didn’t use UTF-8 because it would break the fact that string indexing is O(1).
Re:Why to normalize Unicode strings by int_19h on Wednesday March 13, 2019 @09:38PM (#19385796)
That's just internal representation, though. Semantically, strings are still sequences of chars, and char is still 16-bit, so the API is still UTF-16.