News for hackers. Stuff that matters.
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by nowarninglabel on Saturday October 16, 2010 @12:09AM (#1797334)
>"It turns out the client at the end of the long pipeline of invoices sold a diet pill, and young women were complaining on MySpace and forums that the pill sometimes caused leakage from their..."

So you thought cause you were a consultant that it didn't matter that you were aggregating people's personal posts from MySpace for the purposes of Big Pharma? Surely, we must draw the ethical line somewhere.

Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by marshallk on Saturday October 16, 2010 @12:17AM (#1797341)
Well, it was aggregating complaints of side-effects, which is a good thing for the pharma company to keep track of if they're going to sell such a drug. But yeah, that's why I felt uncomfortable about working with them, didn't continue and now joke about it publicly. Plus it's odd.
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by andrewljohnson on Saturday October 16, 2010 @09:00AM (#1797881)
A company called "Fetch" is very similar to Dapper. Their tech is used to aggregate things like Dow Jones news stories.

They monetized by selling licenses to use their scraper. I wonder why Dapper couldn't do the same?

http://www.fetch.com/

Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by bluesnowmonkey on Saturday October 16, 2010 @01:48PM (#1798398)
> It was beautiful, but people didn't want it, they didn't understand it. Because people are stupid.

I watched his video explaining Dapper and could only loosely follow what he was doing. It was clear that he was making an RSS feed of changes to a web page, but the process of selecting the dynamic elements of the target page was unclear to me. And several times he had to say things like, "Oh, it's confused now. We'll just fix that..."

So maybe you came to the right conclusion that the rest of the world is stupid. Or maybe Dapper was a little difficult to use, and the value proposition was a little vague, and it never really took off. Thousands of cool projects have met the same fate. That's just it goes.

Keep your chin up. At least you got a cool sweatshirt.

Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by danielnicollet on Saturday October 16, 2010 @12:22AM (#1797347)
anyone knows of something equivalent to Dapper out there? I really wish there was since I need this for a project. Thanks!
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by hartror on Saturday October 16, 2010 @01:14AM (#1797404)
Pythoneers have BeautifulSoup, it is fast simple and can deal with real world html. I have used it for site scraping with great success.
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by Luyt on Saturday October 16, 2010 @07:26AM (#1797757)
lxml.html does a pretty good job too, and offers elementtree and xpath querying. http://codespeak.net/lxml/lxmlhtml.html

Recently I used Beautiful Soup in a very simple program to scrape playlists from Soma.fm: http://www.michielovertoom.com/hobby/somafm-playlists/

Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by yurylifshits on Saturday October 16, 2010 @12:39AM (#1797366)
http://webnumbr.com is like dapper for numbers
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by mnutt on Saturday October 16, 2010 @12:47AM (#1797373)
If you're pretty technically inclined and know your way around FireBug/Webkit Inspector, YQL (Yahoo Query Language) is very convenient. It lets you use css selectors to grab data and returns it in JSON or XML.

It's great for quick and dirty hacks, but the big question is how long Yahoo will allow it to stick around.

Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by gtani on Saturday October 16, 2010 @06:29AM (#1797716)
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by danielnicollet on Saturday October 16, 2010 @11:45AM (#1798139)
Thanks for all those great replies. I will now spend some time reviewing!!
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by andrewljohnson on Saturday October 16, 2010 @09:00AM (#1797884)
Fetch, but it's super expensive: http://www.fetch.com/
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by SudarshanP on Saturday October 16, 2010 @12:43PM (#1798256)
http://needlebase.com/ belongs to ITA software being acquired by google... You can find some public datasets at https://pub.needlebase.com/
Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by aditya on Saturday October 16, 2010 @01:08AM (#1797395)
Enjoy it while you can, until an uncaring market starves it to death and it turns into an ad network, for lack of viable alternatives.

Depressing as that is, perhaps the future holds promise. As the cost of building startups keeps trending down, maybe timing will stop mattering as much, and business model innovation (such as freemium) will save good technology from turning into ad networks?

Isn't this part of the skill required to build a successful business anyway, your technology is only as good as the people selling it. Where would google be, if they hadn't hit on AdSense?

Re:How Yahoo's Latest Acquisition Stole & Broke My Heart by lanstein on Saturday October 16, 2010 @12:55AM (#1797384)
Fun fact: Jon is the person who told me about HN in the first place.