News for hackers. Stuff that matters.
Re:Show HN: gofeed, a robust RSS and Atom Parser for Go by pkulak on Thursday April 14, 2016 @10:40PM (#11501718)
Wow, this is great. I built a web scraper in Go a while back that had feed support, and this is exactly what you end up writing. You need the title, description, items, etc, but you really don't care if it's RSS or ATOM. So you translate all that crazy into some common format before you start working with it.

I love how comprehensive this is. I didn't even know a lot of the ways you list to get the different RSS properties. :D

Re:Show HN: gofeed, a robust RSS and Atom Parser for Go by Jemaclus on Thursday April 14, 2016 @07:46PM (#11501120)
This is pretty rad. Is there a way to customize this for non-RSS feeds, or is this pretty much tailored for RSS/Atom feeds?
Re:Show HN: gofeed, a robust RSS and Atom Parser for Go by drakenot on Thursday April 14, 2016 @08:10PM (#11501206)
What is another feed format you'd like to see supported?

If you have some custom thing you could take a look goxpp[0] which is the XML Pull Parser I wrote to use in gofeed.

[0] https://github.com/mmcdole/goxpp

Re:Show HN: gofeed, a robust RSS and Atom Parser for Go by code_research on Friday April 15, 2016 @07:45AM (#11503538)
The selfoss reader [0] has a nice concept of extending the format of the incoming data feeds, would be also a very nice feature for your code. Even nicer it would be if new incoming data formats could be configured in yaml files without having to recompile.

the selfoss author mentions these kind of data:

* RSS Feeds * Images from a RSS Feed * Images from deviantArt Users * Images from tumblr * Your twitter timeline * Tweets of a twitter user * heise News with full content * golem News with full content * MMOSpy News with full content * RSS Feeds with readability

certainly not the most important sources, but it gives an idea about how diverse data sources are on the net today, so limiting to rss and atom is not a good idea. maybe some people would like to add facebook streams or other "social" sources.

Also please take a look at the extensive testing suite of feedparser [1] - lots of feeds there, that will break any naive assumption about how clean real life data will be.

[0] http://selfoss.aditu.de/ [1] https://github.com/kurtmckee/feedparser/tree/develop/tests

Re:Show HN: gofeed, a robust RSS and Atom Parser for Go by drakenot on Friday April 15, 2016 @08:37AM (#11503756)
I've actually already ported hundreds of test cases from Mark Pilgrim's feedparser.
Re:Show HN: gofeed, a robust RSS and Atom Parser for Go by code_research on Friday April 15, 2016 @08:47AM (#11503807)
ah, that is great! I think feedparser has the biggest collection of obscure feeds, it is an awesome collection of what to expect in the wild. If you know some more sources of weird feeds produced by "modern web software", please tell me, thanks!
Re:Show HN: gofeed, a robust RSS and Atom Parser for Go by Jemaclus on Friday April 15, 2016 @01:13AM (#11502344)
I deal with a lot of custom feeds, so not a lot of standard formats. I'll take a look at goxpp! Thank you!
Re:Show HN: gofeed, a robust RSS and Atom Parser for Go by dzdt on Thursday April 14, 2016 @08:29PM (#11501272)
I read it as "goofed" at first.