Re:American Flag Sort
by brirec on Wednesday April 24, 2024 @12:17AM
(#40140521)
This would even break UTF-8, since multi-byte characters are a thing!
[ Parent
| on HN ]
Re:American Flag Sort
by ursusmaritimus on Wednesday April 24, 2024 @04:25AM
(#40141929)
Lexicographic encoding of UTF-8 byte sequences matches lexicographic order of the sequence of Unicode code-points. So you can sort UTF-8 strings as byte strings. Not that sorting by code-points has much meaning, but you can use the Unicode collation algorithm first.
TIL, thanks. That makes sense given how the length prefixes look like but I never thought about it. I wonder if this was by chance or if the UTF-8 creator thought about it.
% printf "%s\n" A B | sort
A
B
% printf "%s" A B | xxd -b -c4
00000000: 11110000 10011101 10010000 10110100 ....
00000004: 11110000 10011101 10010000 10110101 ....
% printf "%s" A B | xxd -c1 -ps | sort | xxd -r -ps | xxd -b -c4
00000000: 10010000 10010000 10011101 10011101 ....
00000004: 10110100 10110101 11110000 11110000 ....
% printf "%s" A B | xxd -c1 -ps | sort | xxd -r -ps
????????
Re:American Flag Sort
by dumbo-octopus on Wednesday April 24, 2024 @12:51AM
(#40140719)
How would that break anything? The strings aren't being split.
Re:American Flag Sort
by EmilyHughes on Wednesday April 24, 2024 @01:18AM
(#40140851)
UTF-8 is downward compatible to ASCII, so anything that is just a standard character (like every character in this comment) is just a byte.