News for hackers. Stuff that matters.

A comment on UTF-8 Everywhere (2012). Parent comment

Re:UTF-8 Everywhere (2012) by mark-r on Sunday June 19, 2016 @11:47PM (#11935936)
It's worse. With UTF-8, if you're not processing it properly it becomes obvious very quickly with the first accented character you encounter. With UTF-16 you probably won't notice any bugs until someone throws an emoticon at you.
[ Parent | on HN ]
Re:UTF-8 Everywhere (2012) by ridiculous_fish on Monday June 20, 2016 @01:48AM (#11936253)
Unfortunately not. It's easy to process UTF-8 such that you mishandle certain ill-formed sequences that you are unlikely to encounter accidentally. IIS was hit [1], Apache Tomcat was hit [2], PHP was hit twice [3] [4].

UTF-16 has its own warts, but invalid code units and non-shortest forms are exclusive to UTF-8.

[1] http://www.sans.org/security-resources/malwarefaq/wnt-unicod...

[2] http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2008-2938

[3] https://www.cvedetails.com/cve/CVE-2009-5016/

[4] https://www.cvedetails.com/cve/CVE-2010-3870/

[ Parent | on HN ]