Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by danielnicollet on Saturday October 16, 2010 @12:22AM
(#1797347)
anyone knows of something equivalent to Dapper out there? I really wish there was since I need this for a project. Thanks!
[ Parent
| on HN ]
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by hartror on Saturday October 16, 2010 @01:14AM
(#1797404)
Pythoneers have BeautifulSoup, it is fast simple and can deal with real world html. I have used it for site scraping with great success.
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by Luyt on Saturday October 16, 2010 @07:26AM
(#1797757)
lxml.html does a pretty good job too, and offers elementtree and xpath querying. http://codespeak.net/lxml/lxmlhtml.html
Recently I used Beautiful Soup in a very simple program to scrape playlists from Soma.fm: http://www.michielovertoom.com/hobby/somafm-playlists/
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by yurylifshits on Saturday October 16, 2010 @12:39AM
(#1797366)
http://webnumbr.com is like dapper for numbers
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by mnutt on Saturday October 16, 2010 @12:47AM
(#1797373)
If you're pretty technically inclined and know your way around FireBug/Webkit Inspector, YQL (Yahoo Query Language) is very convenient. It lets you use css selectors to grab data and returns it in JSON or XML.
It's great for quick and dirty hacks, but the big question is how long Yahoo will allow it to stick around.
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by gtani on Saturday October 16, 2010 @06:29AM
(#1797716)
there's (sort of) related (for-pay) web apps as well:
http://www.metafy.com/index.html
http://www.diffbot.com/howitworks
http://sharedcopy.com/public/andthensome
http://webcache.googleusercontent.com/search?q=cache:L5dhj2w...
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by danielnicollet on Saturday October 16, 2010 @11:45AM
(#1798139)
Thanks for all those great replies. I will now spend some time reviewing!!
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by andrewljohnson on Saturday October 16, 2010 @09:00AM
(#1797884)
Fetch, but it's super expensive: http://www.fetch.com/
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart
by SudarshanP on Saturday October 16, 2010 @12:43PM
(#1798256)
http://needlebase.com/ belongs to ITA software being acquired by google... You can find some public datasets at https://pub.needlebase.com/