News for hackers. Stuff that matters.

A comment on You either die an MVP or live long enough to build content moderation. Parent comment

Re:You either die an MVP or live long enough to build conten... by jffry on Tuesday September 28, 2021 @01:27PM (#28685246)
The good news is that the Unicode consortium has a report on this issue, and the tables already exist for normalization and mapping of confusables to their ASCII lookalikes: https://www.unicode.org/reports/tr39/
[ Parent | on HN ]
Re:You either die an MVP or live long enough to build conten... by Alir3z4 on Tuesday September 28, 2021 @01:32PM (#28685300)
Oh, that's nice.

I guess I can use that next time time to work on the data cleaning for that model.

Thanks.

[ Parent | on HN ]
Re:You either die an MVP or live long enough to build conten... by wanderingstan on Tuesday September 28, 2021 @04:59PM (#28687433)
As I commented above:

I built a Python library for finding strings obfuscated this way. Was critical when moderating our telegram channel before an ICO. https://github.com/wanderingstan/Confusables E.g. "𝓗℮𝐥1೦" would match "Hello"

[ Parent | on HN ]