News for hackers. Stuff that matters.
Re:Unitools – A suite of tools for working with Unicode in t... by jstimpfle on Wednesday March 02, 2016 @10:59AM (#11210715)
I think most software (like programming languages) has actually switched to UTF-8 for internal representation, because it has low footprint (for most applications).

You give up efficient O(1) indexing, but I don't think you typically need that. Indexing is far less meaningful for Unicode compared to ASCII.

Re:Unitools – A suite of tools for working with Unicode in t... by vmorgulis on Wednesday March 02, 2016 @11:11AM (#11210811)
> ... but I don't think you typically need that ...

Yes. String processing often occurs in a loop (like for trim, contains, split ...).

Re:Unitools – A suite of tools for working with Unicode in t... by jstimpfle on Wednesday March 02, 2016 @11:18AM (#11210850)
trim, contains, split (at whitespace, or at a given byte position) can all be implemented efficiently in UTF-8.