Re:Unitools – A suite of tools for working with Unicode in t...
by gjm11 on Wednesday March 02, 2016 @10:52AM
(#11210663)
For internal use, OK, fine. But what part of the following is not "just text"? "Don’t be naïve. £100 is a lot more than €100—and Hélène knows you know that."
[ Parent
| on HN ]
Re:Unitools – A suite of tools for working with Unicode in t...
by TazeTSchnitzel on Wednesday March 02, 2016 @10:56AM
(#11210695)
While you can't represent that as plain ASCII, I think Windows-1252, an 8-bit single-byte encoding, can handle that quite well.
Re:Unitools – A suite of tools for working with Unicode in t...
by kstrauser on Wednesday March 02, 2016 @01:01PM
(#11211674)
That's an excellent point. Let's generalize that Windows-centric idea of a code page to something that can handle most/all known languages: a Universal Coded character set, if you will.
Re:Unitools – A suite of tools for working with Unicode in t...
by pekk on Wednesday March 02, 2016 @11:00AM
(#11210725)
I guess we can get some arbitrary text, then check whether all its characters can be encoded as Windows-1252, store it with a note that it is in Windows-1252, and then check that note before decoding it. Clearly so much better than UTF-8.
Re:Unitools – A suite of tools for working with Unicode in t...
by TazeTSchnitzel on Wednesday March 02, 2016 @11:05AM
(#11210756)
They tried: https://en.wikipedia.org/wiki/ISO/IEC_2022
It was... horrible.