News for hackers. Stuff that matters.
Re:IBM Watson Acquires Technology from Blekko by ChuckMcM on Monday March 30, 2015 @12:08PM (#9290452)
True, but there are some systemic issues that make that pretty challenging. Google is now paying about $4B a year to people to host (or white label) a search box that goes back to Google. Then if you want to offer advertising on your search you generally have to get it from Google too, but that isn't as valuable as it once was and that is a problem for Google.

But perhaps the most interesting thing I've learned from my 5 years at Blekko doing search is that "phase 2 or 3" of the Internet is here. Crawling everything is a waste of resources because 95% of the "new" stuff coming online on the Internet is not information, it is just spam. This combined with advertiser burnout from getting scammed again and again on advertising that claims to generate leads or sales but leads only to click farms. And the whole eco system of the web is in being rocked, along with media distribution. The world is approaching some sort of climactic shift of orientation.

Blekko's key mission has always been to try to find the needles in this exponentially growing pile of hay. And it is something that the folks at Watson really liked about our technology when we first met at their outreach program to connect with startups. That is what lead to their asking us to join them, and no, they weren't particularly interested in the stuff we had done to provide more topical advertising signals. So as a technologist this has been both a validation of our work on finding the real information in the web and making it useful to people, and, when I'm honest with myself, a welcome step away from working on still more advertising technology.

Having the resources to pursue that, and an engine (Watson) that can put it to use, seems pretty exciting.

Re:IBM Watson Acquires Technology from Blekko by jacquesm on Monday March 30, 2015 @01:55PM (#9291263)
The web turned out that way because of google, until google came along the worst we had was on-page keyword spam. Google assigned a value to the links that make up the web and as a result those links were spammed. Hopefully Watson will be able to create a search feature that can not be spammed but so far anything that ends up being a metric that the web pages are rated by will end up being spammed.

Best of luck! At least you're fighting the good fight.