News for hackers. Stuff that matters.
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by danielnicollet on Saturday October 16, 2010 @12:22AM (#1797347)
anyone knows of something equivalent to Dapper out there? I really wish there was since I need this for a project. Thanks!
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by hartror on Saturday October 16, 2010 @01:14AM (#1797404)
Pythoneers have BeautifulSoup, it is fast simple and can deal with real world html. I have used it for site scraping with great success.
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by Luyt on Saturday October 16, 2010 @07:26AM (#1797757)
lxml.html does a pretty good job too, and offers elementtree and xpath querying. http://codespeak.net/lxml/lxmlhtml.html

Recently I used Beautiful Soup in a very simple program to scrape playlists from Soma.fm: http://www.michielovertoom.com/hobby/somafm-playlists/

Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by yurylifshits on Saturday October 16, 2010 @12:39AM (#1797366)
http://webnumbr.com is like dapper for numbers
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by mnutt on Saturday October 16, 2010 @12:47AM (#1797373)
If you're pretty technically inclined and know your way around FireBug/Webkit Inspector, YQL (Yahoo Query Language) is very convenient. It lets you use css selectors to grab data and returns it in JSON or XML.

It's great for quick and dirty hacks, but the big question is how long Yahoo will allow it to stick around.

Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by gtani on Saturday October 16, 2010 @06:29AM (#1797716)
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by danielnicollet on Saturday October 16, 2010 @11:45AM (#1798139)
Thanks for all those great replies. I will now spend some time reviewing!!
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by andrewljohnson on Saturday October 16, 2010 @09:00AM (#1797884)
Fetch, but it's super expensive: http://www.fetch.com/
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by SudarshanP on Saturday October 16, 2010 @12:43PM (#1798256)
http://needlebase.com/ belongs to ITA software being acquired by google... You can find some public datasets at https://pub.needlebase.com/