News for hackers. Stuff that matters.

A comment on How to Analyze Every Reddit Submission and Comment, in Seconds, for Free. Parent comment

Re:How to Analyze Every Reddit Submission and Comment, in Se... by z92 on Saturday October 03, 2015 @03:46PM (#10325095)
Not when the data is like this.

  "Richard, Martin", "23 NS, North Coast, NY"
Comma frequently occurs inside texts, and then awk fails.
[ Parent | on HN ]
Re:How to Analyze Every Reddit Submission and Comment, in Se... by ferrari8608 on Saturday October 03, 2015 @05:57PM (#10325539)
awk -F'", "'

That's apostrophe, quote, comma, space, end quote, apostrophe.

[ Parent | on HN ]
Re:How to Analyze Every Reddit Submission and Comment, in Se... by Rangi42 on Saturday October 03, 2015 @07:37PM (#10325848)
Which still fails if the values contain escaped quotes:

    Name, Age, Address
    "James aka ""Jim"", ""licensed"" attorney", 42, "New York"
That's three values:

    James aka "Jim", "licensed" attorney
    42
    New York
And there are other possible irregularities: zero or N spaces after the comma separators; unquoted values when they're not needed; backslash-escaped special characters; escaping newlines.
[ Parent | on HN ]
Re:How to Analyze Every Reddit Submission and Comment, in Se... by Rotten194 on Saturday October 03, 2015 @06:17PM (#10325599)
What if not all columns are quoted? A lot of the time only the columns that need quoting are quoted and the others are bare.
[ Parent | on HN ]
Re:How to Analyze Every Reddit Submission and Comment, in Se... by z92 on Saturday October 03, 2015 @07:24PM (#10325808)
Nice solution.

Will not work were numeric fields are not quoted.

But nice solution, nevertheless.

[ Parent | on HN ]