Re:Breaking our Latin-1 assumptions (2017)
by hgs3 on Sunday June 19, 2022 @12:52AM
(#31796266)
> I am not aware of any scenario where the code point is meaningfully what you want.
The code point is the most meaningful thing. I'm confused as to what you think you're parsing when you parse text?
> Grapheme clusters are not part of the transmission format.
Absolutely. The intent of my comment was to point out how most programming languages expose strings as some specific UTF encoding rather than exposing them as a collection of code points - exposing strings as UTF anything is a leaky abstraction. An exception could be made for lower level languages, like C, which define strings as pointers to the encoded data.
The code point is the most meaningful thing. I'm confused as to what you think you're parsing when you parse text?
> Grapheme clusters are not part of the transmission format.
Absolutely. The intent of my comment was to point out how most programming languages expose strings as some specific UTF encoding rather than exposing them as a collection of code points - exposing strings as UTF anything is a leaky abstraction. An exception could be made for lower level languages, like C, which define strings as pointers to the encoded data.