News for hackers. Stuff that matters.
Re:Why and how you ought to keep multibyte character support... by kccqzy on Thursday September 29, 2016 @10:17PM (#12610158)
I would say, it should instead reverse extended grapheme clusters. The advent of emojis and emoji ZWJ sequences make those kind of "characters" especially common. For example the family emoji ‍‍‍‍‍‍ is thought of as a single "character" from the user's perspective but it actually has seven code points.

EDIT: HN ate my emoji so there's a link to its emojipedia page: http://emojipedia.org/family-man-woman-girl-boy/

Re:Why and how you ought to keep multibyte character support... by Animats on Friday September 30, 2016 @01:39AM (#12610685)
I had no idea that had been accepted. Here's Unicode TR51, with the whole set.[1]

You can now specify skin tone, but cannot yet mix skin tone within a family group. Someone is probably already demanding that feature.

http://www.unicode.org/reports/tr51/tr51-2.html

Re:Why and how you ought to keep multibyte character support... by legulere on Friday September 30, 2016 @02:24AM (#12610794)
> The advent of emojis and emoji ZWJ sequences make those kind of "characters" especially common.

They're already common through MacOS filesystems. MacOS by standard decomposes characters (ä into ¨+a)

Re:Why and how you ought to keep multibyte character support... by masklinn on Friday September 30, 2016 @08:01AM (#12611922)
> ä into ¨+a

You've reversed the encoding (the combining character follows, so U+00E4 decomposes to U+0061 U+0308), and that's a simpler case as combining characters are combining, they have very specific properties which mark them as combining characters and as continuation of a grapheme. AFAIK that's not the case for ZWJ sequences.

There's also a case to be made for reverse(WOMAN ZWJ HEAVY BLACK HEART ZWJ MAN) to be MAN ZWJ HEAVY BLACK HEART ZWJ WOMAN (sadly the latter does not seem to be handled correctly, at least by Apple's rendering system, it fails to combine into a single "couple" glyph)