News for hackers. Stuff that matters.
Re:Microsoft is not rebasing Windows to Linux by user5994461 on Monday October 12, 2020 @09:43AM (#24754245)
Windows is UTF-16 internally while Linux is UTF-8.

If Windows goes to unicode by default, it will make things a lot worse because it won't be the same unicode.

Re:Microsoft is not rebasing Windows to Linux by AnIdiotOnTheNet on Monday October 12, 2020 @10:02AM (#24754407)
Well, they say UTF-16, but they still allow unpaired surrogates in some places, so it is really more like UCS-2.
Re:Microsoft is not rebasing Windows to Linux by chungy on Monday October 12, 2020 @12:06PM (#24755875)
It is, Windows NT's adoption of Unicode predates UTF-16 and it's impossible to really make it UTF-16 compliant without breaking obscure corners of compatibility.

Most programs assume it's all UTF-16, and it happens to work most of the time... at least until you encounter those sequences that are invalid.

Re:Microsoft is not rebasing Windows to Linux by ChrisSD on Monday October 12, 2020 @11:10AM (#24755163)
Linux also allows invalid utf-8.
Re:Microsoft is not rebasing Windows to Linux by JdeBP on Monday October 12, 2020 @11:31AM (#24755433)
WTF-16 makes the distinction that invalid sequences are allowed.

* http://simonsapin.github.io/wtf-8/