Re:How to Analyze Every Reddit Submission and Comment, in Se...
by Pxtl on Saturday October 03, 2015 @02:10PM
(#10324792)
Microsoft often fails with CSVs actually. I've found I can't copy/paste from Sql Server Management Studio into Excel if you have a mismatched double-quote in a cell - it fails silently and garbles your data.
That was embarrassing.
The CSV format is so messy that even big corporate implementations will have subtle bugs like that. Do not trust it.
Re:How to Analyze Every Reddit Submission and Comment, in Se...
by 0x0 on Saturday October 03, 2015 @03:08PM
(#10324991)
Microsoft excel has the worst CSV defaults. The separating character is even locale-specific! Many locales use semicolon ";" instead of "," as a separator. Great stuff when creating web app exporters.
Re:How to Analyze Every Reddit Submission and Comment, in Se...
by hiperlink on Saturday October 03, 2015 @03:05PM
(#10324976)
> using awk for processing is not a typical pipeline
except it is. (g)awk is more often part of the pipe(d)line than other programming langueage(s) interpreter(s).
Re:How to Analyze Every Reddit Submission and Comment, in Se...
by gruez on Saturday October 03, 2015 @01:35PM
(#10324623)
>More importantly, CSVs are handled natively by statistical programs such as Excel and R
in excel or R? Because I've never encountered problems with tsv files with excel
Re:How to Analyze Every Reddit Submission and Comment, in Se...
by semi-extrinsic on Saturday October 03, 2015 @02:06PM
(#10324765)
R can also read both CSV and TSV just fine. Just use read.csv() or read.table() as you want. Same goes for Pandas.
More importantly, CSVs are handled natively by statistical programs such as Excel and R (you can change the expected delimiter while importing, but in my experience that leads to unexpected results)