News for hackers. Stuff that matters.

A comment on Crafting Interpreters: Strings. Parent comment

Re:Crafting Interpreters: Strings by munificent on Monday September 24, 2018 @03:42PM (#18060765)
Hmm, interesting. I guess they'd likely end up three bytes in UTF-8. Do you have any details you can point me at?
[ Parent | on HN ]
Re:Crafting Interpreters: Strings by camgunz on Monday September 24, 2018 @10:37PM (#18063141)
Nothing like a paper or anything, but just kind of anecdotally I downloaded 西遊記 from Project Gutenberg [1] and measured it. In UTF-8 it's 2,236,564 bytes, in UTF-16 it's 1,554,998 bytes.

[1] https://www.gutenberg.org/files/23962/23962-0.txt

[ Parent | on HN ]