Re:Corrected UTF-8
by panpog on Sunday July 06, 2025 @10:11PM
(#44486079)
Can you fit everything into 32 bits? I have no idea, but Hangul and indict scripts seem like they might have a combinatoric explosion of infrequently used characters.
[ Parent
| on HN ]
But they don't have that explosion if you only encode the combinatoric primitives those characters are made of and then use composing rules?
You still get the combinatoric explosion, but you have more bits to work with. Imagine if you could combine any 9 jamo into a single hangul syllable block. (The real combinatorics is more complicated, and I don't know if it's this bad.) Encoding just the 24 jamo and a a control character requires 25 codepoints. Giving each syllable block its own codepoint would require 24^9>2^32 codepoints.