News for hackers. Stuff that matters.
Re:The dangers of streaming across versions of glibc: A caut... by jandrese on Wednesday January 09, 2019 @02:15AM (#18862911)
Case normalization is it's own minefield in Unicode.

This article discusses some of the challenges: https://stackoverflow.com/questions/6162484/why-does-modern-...

In the first section points 16, 22, and 23 are relevant, in the second section look at points 8, 9, 10, 11, 12, 13, and 40.

Sorting based on Unicode strings is tricky, especially if you want cross platform compatibility. It's better today but there are still a lot of edge cases to consider if you have any hope of getting the same sort twice from "interesting" data.

There are no comments on this comment yet.