Show HN: Automatic web page content extractor for Node.js and the command line

Re:Show HN: Automatic web page content extractor for Node.js... by edwinyzh on Saturday July 05, 2014 @04:20AM (#7991341)

Can I use it to monitor source code changes of a Google Code projects, eg (https://code.google.com/p/dcef3/source/list), or a github project? If not can anybody recommend a good tool for this kind of task? Thanks.

[ Parent | on HN ]

Re:Show HN: Automatic web page content extractor for Node.js... by MattJ100 on Saturday July 05, 2014 @05:25AM (#7991435)

If you look at the source of that page, you'll see:

  <link type="application/atom+xml" rel="alternate" href="/feeds/p/dcef3/gitchanges/basic">

which refers to an Atom feed for the project's commits.

Same for Github projects, e.g. at https://github.com/petdance/ack2 you will find:

  <link href="https://github.com/petdance/ack2/commits/dev.atom" rel="alternate" title="Recent Commits to ack2:dev" type="application/atom+xml" />

[ Parent | on HN ]

Re:Show HN: Automatic web page content extractor for Node.js... by edwinyzh on Saturday July 05, 2014 @06:07AM (#7991490)

Great! Thanks for the info, and sorry for the dump question without doing any research myself first - that idea occurred to me but I've never had the time to investigate into it :P

[ Parent | on HN ]

Re:Show HN: Automatic web page content extractor for Node.js... by flusensieb on Saturday July 05, 2014 @05:22AM (#7991429)

You can use the "Git source changes" atom feed from https://code.google.com/p/dcef3/feeds

There's similar functionality on github (but I haven't found documentation for it)... Example: https://github.com/shirou/kptool/commits/master.atom

[ Parent | on HN ]

Re:Show HN: Automatic web page content extractor for Node.js... by binarymax on Saturday July 05, 2014 @04:52AM (#7991383)

http://watchthatpage.com

[ Parent | on HN ]