News for hackers. Stuff that matters.
Re:Ftfy – fix Unicode that's broken in various ways by tzahola on Tuesday January 09, 2018 @03:58AM (#16104621)
No, Unicode text is not broken. It’s either your program that’s broken, for it is interpreting ISO-8859-X/Windows-12XX/whatever as UTF-X; or the program that produced said data.
Re:Ftfy – fix Unicode that's broken in various ways by rspeer on Tuesday January 09, 2018 @04:10AM (#16104674)
I wrote the original library. Your statement is true, but in many cases, not useful.

As quoted from the documentation [1]:

> Of course you're better off if your input is decoded properly and has no glitches. But you often don't have any control over your input; it's someone else's mistake, but it's your problem now.

[1] https://github.com/LuminosoInsight/python-ftfy

Re:Ftfy – fix Unicode that's broken in various ways by drinchev on Tuesday January 09, 2018 @04:33AM (#16104774)
That's what I think as well. My native is Bulgarian and I've been through the whole range, you mentioned.

What saves me is having File -> Open with Encoding ( Sublime Text ). Unfortunately they removed it from Chrome [1].

https://superuser.com/questions/1160003/how-do-i-change-the-...