News for hackers. Stuff that matters.

A comment on Brian Kernighan adds Unicode support to Awk. Parent comment

Re:Brian Kernighan adds Unicode support to Awk by hgs3 on Saturday August 20, 2022 @08:40PM (#32536386)
UTF-32 performance woes are exaggerated. UTF-8 decoding requires branching whereas UTF-32 does not and in terms of storage real world text does not consume much space.
[ Parent | on HN ]
Re:Brian Kernighan adds Unicode support to Awk by kzrdude on Sunday August 21, 2022 @04:16AM (#32538304)
Utf32 has the BOM which adds complexity and at least a top level branch. Maybe it's not so bad in practice, just duplicated generated code.

But as an internal representation, some of it can be ignored by choice.

[ Parent | on HN ]