News for hackers. Stuff that matters.

A comment on Why GNU moe does not use UTF-8 or other form of Unicode?.

Re:Why GNU moe does not use UTF-8 or other form of Unicode? by wruza on Wednesday January 19, 2022 @04:26AM (#29991562)
For example, searching for a word like "file" in an Unicode document may fail if the document uses the presentation form (compound character) 'fi' instead of the two-character string "fi".

Not an issue in a collation-aware search. Test here by searching for "fi": https://en.wikipedia.org/wiki/Ligature_(writing)

[ Parent | on HN ]
Re:Why GNU moe does not use UTF-8 or other form of Unicode? by satiric on Wednesday January 19, 2022 @03:57PM (#30000004)
Just tried this on Firefox on Linux. It finds "fi" instances in a word like "first", since that's rendered as separate characters on my system, but not when wikipedia specifically uses the fi ligature.
[ Parent | on HN ]