You could also pack three 20-bit numbers into a 64-bit word, if you needed it. Then again, the C family languages are kind of weird about that.
Unicode code points are 21 bits long. I wonder if something out there stores strings by packing 3 code points per uint64_t.
Re:My int is too big
by charleslmunger on Friday July 15, 2016 @11:49PM
(#12105158)
Maybe, but almost everything outside the basic multilingual plane is so infrequently used that it's a waste of space to use a fixed-width format.
But I could see it being a useful replacement for UTF-32... If you need to be able to calculate code points in constant time, and you don't mind wasting one bit out of every 64. Self synchronizing, constant time code point count from buffer size, and close to as space efficient as UTF-16, but with none of the surrogate mess.
Try storing a few billion of them, they're half the size.
> In C code that we write, we have a rule that every use of plain 'int' must be justified - it's a "code smell"
Current MISRA C requires this.