News for hackers. Stuff that matters.

A comment on Ftfy – fix Unicode that's broken in various ways. Parent comment

Re:Ftfy – fix Unicode that's broken in various ways by 534b44a on Tuesday January 09, 2018 @12:00PM (#16107596)
Thank you, I'd also tested that but it seems to simply remove the mangled string part. Maybe it's impossible to recover it automatically after all :/
[ Parent | on HN ]
Re:Ftfy – fix Unicode that's broken in various ways by rspeer on Tuesday January 09, 2018 @12:58PM (#16108163)
No, no. That is the recovered text.

Originally, the text had one non-ASCII character, an upside-down exclamation point. A series of unfortunate (but typical) things happened to that character, turning it into 9 characters of nonsense, the 9th of which is also an upside-down exclamation point.

It looks like ftfy is just removing the first 8 characters, but it's reversing a sequence of very specific things that happened to the text (which just happens to be equivalent to removing the first 8 characters).

[ Parent | on HN ]