Re:Resetting PHP6 (or: Unicode claims another victim)
by drm237 on Tuesday March 30, 2010 @01:30PM
(#1229677)
I would guess file encoding is not at all the limiting factor since often times opcode caches mean that the file is only read once anyway. The problem is that you get input for all sorts of other areas like forms, databases, web services, etc. most of which aren't UTF-16.
Re:Resetting PHP6 (or: Unicode claims another victim)
by wingo on Tuesday March 30, 2010 @04:04PM
(#1230013)
> And frankly, if you don't roll it yourself, what are you going to use other than ICU?
GNU libunistring: http://www.gnu.org/software/libunistring/
A file is very very very simple to convert once. Tell your developers, "If you don't encode in UTF-16, you will have a performance penalty. Set your file encodings as UTF-16 too. You weren't doing complex internationalization work before, it's really not that big a deal."
I worked with someone who had been on the ICU project, and he argued that UTF-16 is the best compromise for most cases. If you're working primarily in the western character set, UTF-8 is attractive, but that comes at the expense of others.
And frankly, if you don't roll it yourself, what are you going to use other than ICU?