News for hackers. Stuff that matters.
Re:Things That Turbo Pascal is Smaller Than by Sukotto on Monday October 31, 2011 @01:13PM (#3178147)
No feed? No problem.

My go-to tool for sites without rss is http://feed43.com which I find easy to set up. Also important to point out that it plays nice with the sites it scrapes.

Example... Problem: I love lurking in ask.metafilter but only want to see threads that have a "best answer" marked. No official feed for that.

Solution: http://feed43.com/2602451534003772.xml

Problem: I really like the PS238 comic but there's no direct feed

Solution: http://feed43.com/ps238-link-only.xml

Another tool that looks promising but I haven't really dug into yet is http://scraperwiki.com (pardon the pun)

Re:Things That Turbo Pascal is Smaller Than by lordgilman on Monday October 31, 2011 @08:00PM (#3179790)
I'm also a huge fan of feed43 but I've managed to hit my head more than a few times on its limitations. Coincidentally just this weekend I wrote a teeny program as a replacement for feed43. I've got all my scrapers working with XPath (which I prefer for this situation) but it's very straightforward to add a new site. https://github.com/dgilman/atom_maker