News for hackers. Stuff that matters.
Re:The ü/ü Conundrum by eviks on Sunday March 24, 2024 @11:25PM (#39812611)
Would it still be harmful if language tag were used?
Re:The ü/ü Conundrum by lmm on Sunday March 24, 2024 @11:37PM (#39812664)
If the tag mechanism was used consistently and handled by all software, no. But in practice the only way that would happen is if the tag mechanism was required for many languages. Unicode is, in practice, a system that works the same way for ~every human language except Japanese, which makes it much worse than the previous "byte stream + encoding" system where any program written to support anything more than just US English would naturally work correctly for every other language, including Japanese.
Re:The ü/ü Conundrum by renhanxue on Monday March 25, 2024 @08:51AM (#39815680)
> Unicode is, in practice, a system that works the same way for ~every human language except Japanese

This is simply not true. As I've pointed out in a sibling comment, Unicode has a lot of surprising and frustrating behaviors with many European languages as well if you use it without locale data. The characters will look right, but e.g. searching, sorting and case-insensitive comparisons will not work as expected if the application is not locale aware.

Re:The ü/ü Conundrum by lmm on Monday March 25, 2024 @06:40PM (#39822050)
> The characters will look right, but e.g. searching, sorting and case-insensitive comparisons will not work as expected

This is quite a different situation from Japan. A lot of applications don't do searching, sorting, or case-insensitive comparisons, but virtually every application displays text.