News for hackers. Stuff that matters.
Re:How to share your data effectively by shrikant on Monday April 08, 2013 @04:18PM (#5514258)
I've always found the C in CSVs to be needlessly limiting. I'm not aware of any tool that contextualise commas in addresses and other "free text" fields that might form part of the data dump/extract.

For this reason, I am strongly in favour of pipe-separated values in such files. The probability that a data extract has a pipe symbol in any data field is quite small (in my experience, it's been 0 so far).

The first thing I do in any Windows system I have to use on a regular basis is to change the the system separator to '|' in the Regional Settings..

Re:How to share your data effectively by prodigal_erik on Monday April 08, 2013 @05:57PM (#5514906)
Then you run into ASCII art some end user made, or pre-Unicode text from Scandinavia where 0x7C was the code point of a letter. Commas make it pretty obvious which tools are unusably broken, where very rare characters let these bugs go undetected far too long.
Re:How to share your data effectively by coldtea on Monday April 08, 2013 @04:46PM (#5514469)
And then you get sent the file:

Statistics on 100000 UNIX shell one liners!

Re:How to share your data effectively by kyllo on Monday April 08, 2013 @04:48PM (#5514487)
Yes, pipe-delimited format is great, and much easier to parse than comma-delimited.

Tab-delimited is also better than comma-delimited, I think.

Commas just have far too high a probability of appearing within the data itself, and when you hit a comma that was supposed to be escaped, it adds an extra column to the row, screwing everything up.

Re:How to share your data effectively by jleader on Monday April 08, 2013 @08:41PM (#5515730)
Tabs are great, until you try to explain to a non-programmer why your tool doesn't parse their file correctly, even though in the word-processor they're using as a text editor it looks identical to another file that parses correctly.
Re:How to share your data effectively by r00fus on Monday April 08, 2013 @05:28PM (#5514753)
Tab-seperated is also very common, and I find better - how often are you storing text-formatting within cell for a data interchange? Similar to pipes, tabs are much less common than commas.
Re:How to share your data effectively by grannyg00se on Tuesday April 09, 2013 @12:39AM (#5516471)
I also find the C in CSVs to be needlessly limiting. Especially since ASCII already comes defined with characters for record separator (30), unit separator(31), and group separator(29).
Re:How to share your data effectively by qw on Monday April 08, 2013 @05:15PM (#5514665)
Excel and other tools can handle commas if you use quoted fields. Unfortunately this generates a new problem when you need to escape quotes inside a quoted field. There is no universal escape method.
Re:How to share your data effectively by eksith on Monday April 08, 2013 @04:54PM (#5514531)
Same for me. CSVs would be far less likely to mess up the data if they were PSVs instead.