Re:Emojis paved the way for UTF-8 everywhere
by Dylan16807 on Wednesday November 18, 2020 @02:02AM
(#25133947)
The density drops off but it's still good density. It's not a problem. And the amount of CPU you need to do the bit shifts is negligible.
Shift JIS requires you to track extra context when you're actively using the text. That's going to take extra space. I bet that in most of the situations where shift JIS meaningfully wins out, you could get more benefit by using a combination of UTF-8 and Zstd.
Shift JIS requires you to track extra context when you're actively using the text. That's going to take extra space. I bet that in most of the situations where shift JIS meaningfully wins out, you could get more benefit by using a combination of UTF-8 and Zstd.