Re:Unicode sorting is hard and why browsers added special em...
by est on Monday June 28, 2021 @02:04AM
(#27658606)
Hangul has order because it's enumerable. Hanja on the other hand, does not have order and it's not enumerable.
(not enumerable as in written text as strokes can be combined and invented on the fly, enumerable if you think it's a finite charset on computers)
Re:Unicode sorting is hard and why browsers added special em...
by yorwba on Monday June 28, 2021 @05:08AM
(#27659564)
New characters can be invented on the fly, but not every random scribble would be considered a character. In practice, only a handful of different stroke types are used, which gives even newly invented nonsense characters a recognizable visual style. For any finite stroke count, there's only a finite number of combinations, so the infinte set of characters with unbounded stroke count can be enumerated.
It can also be sorted using the radical and stroke count, although then you can't enumerate it in order because there's an infinite number of possible characters for each radical.
Re:Unicode sorting is hard and why browsers added special em...
by oehtXRwMkIs on Monday June 28, 2021 @02:05AM
(#27658608)
It's so annoying how "CJK" groups Hangul with completely different writing systems. And even makes people think they're similar.
Re:Unicode sorting is hard and why browsers added special em...
by gumby on Monday June 28, 2021 @02:14AM
(#27658658)
Well, Hanja can also appear inline in otherwise Hangul texts. Vietnamese has a similar issue though their use of an extended Roman alphabet ended up in a slightly different place, Unicode-wise. I don't remember the decision but I believe it might have been at the request of some RoK people.
There might also be an issue if old Hanja-only texts need to be handled differently from Hanzi rendering/processing. That would not surprise me.
Still, I agree it seems pretty weird.
Re:Unicode sorting is hard and why browsers added special em...
by lmm on Monday June 28, 2021 @03:00AM
(#27658852)
Hangul and Hiragana are not so dissimilar AFAIK? But the point of saying "CJK" is the other direction: codepoints subject to Han unification may represent Hanzi, Kanji or Hanja.
Re:Unicode sorting is hard and why browsers added special em...
by anoncake on Monday June 28, 2021 @04:53PM
(#27667962)
Hangul is actually just an alphabet. Each square hangul character is composed of 2-3 letters. Hiragana is a syllabary.
Re:Unicode sorting is hard and why browsers added special em...
by DemocracyFTW on Monday June 28, 2021 @06:23AM
(#27659991)
> Korean alphabet (Hangul) is fully ordered
Buuuut historically, there have been several ways to arrange Hangul linearly, and the prevailing sorting in dictionaries differes between North and South Korea.
Re:Unicode sorting is hard and why browsers added special em...
by lifthrasiir on Monday June 28, 2021 @06:39AM
(#27660101)
This is why I had to point out that order does exist, just that there are too many such orders.
[1]: https://en.wikipedia.org/wiki/Hangul#Alphabetic_order
[2]: https://unicode.org/charts/PDF/UAC00.pdf