News for hackers. Stuff that matters.
Re:How to share your data effectively by jrajav on Monday April 08, 2013 @03:51PM (#5514067)
From someone currently dealing with Excel's CSV writing for a business application, I heartily concur. There is a decade old bug (at least) where the CSV save as format does not properly handle Unicode, and there's no simple way to handle it down the pipeline. I guess the Office team would rather work on the metro ribbon.
Re:How to share your data effectively by thomasz on Monday April 08, 2013 @04:31PM (#5514362)
"Save as CSV" produces text encoded in the users ANSI codepage which is atrocious, Excel 2007+ at least has "Save as Unicode Text" which produces \t separated UTF16 output.
Re:How to share your data effectively by justincormack on Monday April 08, 2013 @04:55PM (#5514540)
Well CSV has no real specification, or way to store metadata eg about encoding. It is a terrible format.
Re:How to share your data effectively by UnoriginalGuy on Monday April 08, 2013 @05:16PM (#5514673)
Re:How to share your data effectively by justincormack on Monday April 08, 2013 @05:30PM (#5514764)
As I said, no real specification. It reads "This section documents the format that seems to be followed by most implementations". Another part reads "Each field may or may not be enclosed in double quotes (however some programs, such as Microsoft Excel, do not use double quotes at all)."

The RFC is a useful collection of anecdotes...

Re:How to share your data effectively by anonydsfsfs on Tuesday April 09, 2013 @12:11AM (#5516404)
The HTTP 1.0 RFC says the same thing:

http://tools.ietf.org/html/rfc1945#page-4

"This specification describes the features that seem to be consistently implemented in most HTTP/1.0 clients and servers."

Is HTTP not a real specification either?

Re:How to share your data effectively by justincormack on Tuesday April 09, 2013 @03:40AM (#5516898)
And then laid down which ones would be used and exactly how, and how to specify that you conform. Http is just describing process of how the spec came about. Because there is no metadata in csv you cannot even say how or if you conform.
Re:How to share your data effectively by merlincorey on Monday April 08, 2013 @05:17PM (#5514683)
Meet RFC 4180 - http://www.ietf.org/rfc/rfc4180.txt

(Yes, it's not an internationally recognized standard, but neither is HTTP or IRC)

Re:How to share your data effectively by npsimons on Monday April 08, 2013 @08:01PM (#5515559)
I guess the Office team would rather work on the metro ribbon.

Of course they would! They've already achieved their goal with Excel: make it a lock-in product. In this case, they did it by breaking CSV compatibility, thereby forcing everyone to use XLSX.

Re:How to share your data effectively by niggler on Monday April 08, 2013 @04:45PM (#5514463)
'CSV save as format does not properly handle Unicode'

[MS-XLS] ends up using special codepages (e.g. http://www.unicode.org/Public/MAPPINGS/VENDORS/MICSFT/WINDOW...) for representing characters, so you need to make sure the same codepage is used through all of your applications.

Example: For those that have access to windows and macintosh excel, CHAR(240) is the apple logo on mac but something different on windows.

Re:How to share your data effectively by bjhoops1 on Monday April 08, 2013 @04:49PM (#5514493)
> I guess the Office team would rather work on the metro ribbon.

Zing! Thank you for that.