News for hackers. Stuff that matters.
Re:Finding CSV files that start with a BOM using ripgrep by Dylan16807 on Saturday May 29, 2021 @04:16PM (#27327954)
The only way to "properly" have a fixed width encoding is to allocate 80-128 bytes per character. Anything else will break horribly on accents and other common codepoints. So everyone uses the less-easy methods.

I base this number off the "Stream-Safe Text Format" which suggests that while it's preferred that you accept infinitely-long characters, a cap of 31 code points is more or less acceptable.

There are no comments on this comment yet.