Re:Why to normalize Unicode strings
by kevin_thibedeau on Wednesday March 13, 2019 @02:22PM
(#19381763)
Normalization covers more than just combining characters. CJK full width digits and punctuation can be problematic when you want the canonical forms for pattern matching:
[ Parent
| on HN ]
It's called collation
> $*COLLATION.set(:!secondary:!tertiary:!quaternary)
collation-level => 1, Country => International, Language => None, primary => 1, secondary => 0, tertiary => 0, quaternary => 0
> '12' coll '12'
Same