TSV Utilities: Command line tools for large, tabular data files

Re:TSV Utilities: Command line tools for large, tabular data... by perl4ever on Sunday September 01, 2019 @01:37AM (#20850653)

For some reason, in some circles, it seems to be semi standard to use þ (0xFE aka thorn) as the delimiter and a paragraph symbol (0x14 aka DC4 aka ^T) as the separator. The latter is not to be confused with 0xB6.

Anyway, these character are presumably not going to occur in ordinary text.

[ Parent | on HN ]

Re:TSV Utilities: Command line tools for large, tabular data... by PeterisP on Sunday September 01, 2019 @04:33AM (#20851173)

All of "upper ascii half" can occur in ordinary text in "pre-Unicode" encodings.

0xFE is a good example - you may get a customer or employee from Iceland with that character in their name (e.g. https://en.wikipedia.org/wiki/Haf%C3%BE%C3%B3r_J%C3%BAl%C3%A...), or data in cyrillic cp1251 or koi8-r enconding where 0xFE also represents characters that you'll encounter in surnames, etc.

[ Parent | on HN ]

Re:TSV Utilities: Command line tools for large, tabular data... by perl4ever on Sunday September 01, 2019 @09:45PM (#20856191)

It would be escaped in that case.

[ Parent | on HN ]