News for hackers. Stuff that matters.

A comment on Ask HN: How to aggregate product info from other websites.

Re:Ask HN: How to aggregate product info from other websites by astrec on Sunday November 09, 2008 @11:32PM (#358869)
Python & Beautiful Soup (http://www.crummy.com/software/BeautifulSoup/) are your friends here.
[ Parent | on HN ]
Re:Ask HN: How to aggregate product info from other websites by jreilly on Sunday November 09, 2008 @11:44PM (#358885)
Anyone know of a similar library in rails that works well?
[ Parent | on HN ]
Re:Ask HN: How to aggregate product info from other websites by rgrieselhuber on Monday November 10, 2008 @12:13AM (#358904)
I'm pretty sure this (HPricot) is the one most people use in Ruby:

http://code.whytheluckystiff.net/hpricot/

[ Parent | on HN ]
Re:Ask HN: How to aggregate product info from other websites by abijlani on Monday November 10, 2008 @01:55AM (#358959)
Here's a great hpricot tutorial

http://www.igvita.com/2007/02/04/ruby-screen-scraper-in-60-s...

[ Parent | on HN ]
Re:Ask HN: How to aggregate product info from other websites by qhoxie on Monday November 10, 2008 @02:30AM (#358990)
hpricot is great, but I hear lately that Nokogiri is faster and just as capable:

http://github.com/tenderlove/nokogiri/tree/master

[ Parent | on HN ]
Re:Ask HN: How to aggregate product info from other websites by ivanstojic on Monday November 10, 2008 @06:22AM (#359109)
Nokogiri even has a HPricot emulation mode, if you need to port HPricot code.
[ Parent | on HN ]