News for hackers. Stuff that matters.
Re:Text Is the Universal Interface by anotheronebites on Wednesday October 05, 2022 @02:02PM (#33099006)
ASCII and unicode are subtly different things.

you should compare ASCII with one of the UTF encodings of unicode.

the 'unicode' for ASCII's would be just the english alphabet extended with digits and a few more special control characters.

Re:Text Is the Universal Interface by giantrobot on Wednesday October 05, 2022 @02:17PM (#33099210)
That's what the GP is saying. You can't really tell a priori what encoding to use for a stream of "text" (bytes). Without some sort of metadata about the stream you just have to guess. Convention will help you make an informed guess but it's not guaranteed to be correct. Then stuff breaks in unexpected and stupid ways.
Re:Text Is the Universal Interface by falcolas on Wednesday October 05, 2022 @02:13PM (#33099148)
Constraining Unicode encodings to a fewer than 4 bytes means we limit how many countries can use text interfaces in their language. Or how much data from those countries can be passed between programs.
Re:Text Is the Universal Interface by blueflow on Wednesday October 05, 2022 @02:45PM (#33099637)
We do not have enough countries to fill up all that space. For UTF-8 with a 4-byte restriction, less than 18% of the available space is currently allocated to blocks.