Re:UTF-8 characters that behave oddly when the case is changed
by throwaway173920 on Friday November 01, 2024 @09:53AM
(#42016936)
In one of my work projects it was the Turkish İ that gave us trouble. In some case-insensitive text searching code, we matched the lowercase query against the lowercase text, and had to handle cases like that specially to avoid reporting the wrong matching span in the original text, since the lowercase string would have a different length than the uppercase string. This was one of my first real-world projects and opened my eyes a bit to the importance of specifications and standards.
[ Parent
| on HN ]
Re:UTF-8 characters that behave oddly when the case is changed
by pavel_lishin on Friday November 01, 2024 @10:56AM
(#42017524)
Can't mention the Turkish case situation without mentioning the actual murder that took place because of it: https://languagelog.ldc.upenn.edu/nll/?p=73
Re:UTF-8 characters that behave oddly when the case is changed
by Filligree on Friday November 01, 2024 @11:31AM
(#42017948)
The murder is a tragedy, of course, but I would hesitate to blame the cellphone. There’s overreactions, and then there’s… this.
Re:UTF-8 characters that behave oddly when the case is changed
by oguz-ismail on Friday November 01, 2024 @12:05PM
(#42018349)
> I would hesitate to blame the rapist, look at what she was wearing!
Re:UTF-8 characters that behave oddly when the case is changed
by hinkley on Friday November 01, 2024 @12:12PM
(#42018425)
Except in this case the phone was the dress.
Re:UTF-8 characters that behave oddly when the case is changed
by johannes1234321 on Friday November 01, 2024 @10:02AM
(#42016990)
In PHP the Turkish locale caused quite some trouble. In some situations a different locale was used for compiling and for runtime while handling "case-insensiteve" identifiers, fo that sometimes names with an "I" could not be found anymore.
Re:UTF-8 characters that behave oddly when the case is changed
by Rendello on Friday November 01, 2024 @02:00PM
(#42019724)
I had this exact bug with the same character:
https://github.com/rendello/layout/issues/8#issuecomment-235...