This is not a trivial point -- there are plenty of specs which are sloppy about text, try to abstract over code points, and result in non-working software.
Re:A Sketch of the Biggest Idea in Software Architecture (2022)
by rusk on Tuesday April 23, 2024 @05:57AM
(#40130214)
Of course it’s all bytes. It’s all bytes. That doesn’t change the fact that you need to have some awareness of encoding before those bytes are fully sensible
That's a feature, not a bug.
i.e. "exterior designs are layered" - https://www.oilshell.org/blog/2023/06/ysh-design.html#exteri...
This is not a trivial point -- there are plenty of specs which are sloppy about text, try to abstract over code points, and result in non-working software.
A main example is the shitshow with libc and Unicode - https://thephd.dev/cuneicode-and-the-future-of-text-in-c#sta...
It suffers from what I call "interior fictions", like wchar_t.