News for hackers. Stuff that matters.
Re:Ask HN: Unicode text variants? by Someone on Wednesday March 12, 2014 @03:43AM (#7384435)
Canonicalization is more restricted and different.

More restricted in that it only treats truly identical strings that have multiple representations the same. Normalization won't turn "foo" and "FOO" into the same string, but it will turn "fòó" and "fo<with grave accent>o<with acute accent>" into the same string.

Different in the sense that it creates a new string, rather than comparing two strings. Just like you neither need nor want to do a tolower(s) when comparing case-insensitively, you don't need nor want to normalize unicode to do a normalization invariant comparison.

The unicode standard uses "equivalence" to treat "<fl ligature>" and "fl" as equivalent (see http://en.wikipedia.org/wiki/Unicode_equivalence; Unicode technical report on normalization at http://www.unicode.org/reports/tr15/tr15-18.html)

Re:Ask HN: Unicode text variants? by patio11 on Wednesday March 12, 2014 @04:21AM (#7384526)
Thanks; you're right.
Re:Ask HN: Unicode text variants? by pornel on Wednesday March 12, 2014 @09:18AM (#7385345)
NFKD changes some characters significantly, e.g. ² changes to 2.