News for hackers. Stuff that matters.
Re:Ftfy – fix Unicode that's broken in various ways by crdoconnor on Tuesday January 09, 2018 @07:26AM (#16105638)
Isn't it better staying out? It seems like it shares similar properties to pytz - new codecs need to be added semi-regularly.

What was it Kenneth Reitz said? Something like standard library is where packages go to die.

Re:Ftfy – fix Unicode that's broken in various ways by rspeer on Tuesday January 09, 2018 @07:51AM (#16105768)
Yeah, I know the saying.

My observation here is that the number of text encodings is generally decreasing, due to the fact that UTF-8 is obviously good. I want wacky encodings to die. But this is just a class of encodings that have existed for decades and that Python missed. Perhaps on the basis that they were non-standard nonsense, but now they're standardized.

It could be argued that web-windows-1252 is the third most common encoding in the world.

If I'm giving directions for how to decode text in this encoding, it currently only works if you've imported ftfy first, even if you don't need ftfy.

Re:Ftfy – fix Unicode that's broken in various ways by simonw on Tuesday January 09, 2018 @10:32AM (#16106838)
Sounds to me like you've argued yourself around to pitching them for inclusion! I find the argument that web-windows-1252 is supported by modern browsers very convincing.
Re:Ftfy – fix Unicode that's broken in various ways by crdoconnor on Tuesday January 09, 2018 @10:05AM (#16106619)
If they're all 10 years old and on their way out then yeah, I suppose it would make sense to include them in python - whether or not they're nonsense.
Re:Ftfy – fix Unicode that's broken in various ways by maxerickson on Tuesday January 09, 2018 @08:43AM (#16106050)
Presumably the way to do it would be to add the individual encodings as modules in https://github.com/python/cpython/tree/master/Lib/encodings so the risk of stagnation would be low.

I guess the bigger issue would be bikeshedding the names and aliases...