News for hackers. Stuff that matters.

shinalin

Re:You can't just assume UTF-8 on Tuesday April 30, 2024 @04:45PM (#40216124)
Well, it's great that you did some tests a few years back, but I'm not sure how that qualifies you to make such a sweeping generalization about CJK text encoding. It's easy to dismiss UTF-16's benefits when you're only looking at a narrow slice of the real world, ignoring the vast amounts of pure CJK literature, historical archives, and user-generated content out there.