News for hackers. Stuff that matters.
Re:The UTF-8-Everywhere Manifesto by sopooneo on Sunday April 29, 2012 @02:39PM (#3906630)
Thank you. That is very good to learn and I looked over the wikipedia article. But as far as byte order, how is that architecture independent? Is it just that utf-8 dictates that the order of the bytes always be the same, so whatever system you're on, you ignore its norm, and interpret bytes in the order utf-8 tells you to?
Re:The UTF-8-Everywhere Manifesto by lambda on Sunday April 29, 2012 @03:16PM (#3906750)
Yes, basically. UTF-8 doesn't encode a code point as a single integer; it encodes it as a sequence of bytes, with a particular order, where some of the bits are used to represent the code point, and some of them are just used to represent whether you are looking at an initial byte or a continuation byte.

I'd recommend checking out the description of UTF-8 in Wikipdia. The tables make it fairly clear how the encoding works: http://en.wikipedia.org/wiki/UTF-8#Description

Re:The UTF-8-Everywhere Manifesto by ori_b on Sunday April 29, 2012 @03:03PM (#3906689)
utf-8 is a single byte encoding. Reversing the order of a sequence that's one byte long just gives back that one byte.
Re:The UTF-8-Everywhere Manifesto by kijin on Sunday April 29, 2012 @07:46PM (#3907487)
No it isn't. Any letter with an accent will take up two bytes. Most non-Latin characters take up three bytes, sometimes even four.
Re:The UTF-8-Everywhere Manifesto by ori_b on Monday April 30, 2012 @09:08AM (#3909036)
Poorly phrased. It can take multiple bytes to fully define one codepoint, but the encoding is defined in terms of a stream of single bytes. In other words, each unit is one byte, hence flipping each unit gives back the same unit.

This is not the case for UTF-16 and UTF-32.

Re:The UTF-8-Everywhere Manifesto by ybungalobill on Tuesday May 01, 2012 @03:28AM (#3913375)
AFAIK the correct term is "byte oriented".
Re:The UTF-8-Everywhere Manifesto by Tloewald on Sunday April 29, 2012 @09:47PM (#3907687)
Yes but those two bytes will be in the same order regardless of the endianness of the system.