News for hackers. Stuff that matters.
Re:String types in Rust by Gankro on Monday March 28, 2016 @06:34PM (#11378000)
And on Windows it's "potentially ill-formed UTF-16": https://simonsapin.github.io/wtf-8/

Basically if your language/std-lib claims to be cross platform and considers paths to be definitely-utf8, it's busted. I think, maybe, plan9 is a case where this claim holds?

Re:String types in Rust by gsnedders on Monday March 28, 2016 @08:56PM (#11378782)
> And on Windows it's "potentially ill-formed UTF-16"

On Windows, and in many Windows APIs, the return value is a "sequence of UTF-16 code units" (which is essentially a fancy way of saying "a sequence of 16-bit words"). This goes back to Windows originally using UCS-2, where any sequence of 16-bit words is valid (because there wasn't any concept of a surrogate, yet alone a lone surrogate), given its support predates the Unicode consortium extending Unicode to 21-bits and along with it UTF-16's existence (1996).