News for hackers. Stuff that matters.
Re:Google: Hide sites to find more of what you want by ChuckMcM on Thursday March 10, 2011 @04:01PM (#2310755)
Ah, good to see Google following our lead :-) (Disclaimer I work at Blekko and we've had this feature from launch, and we don't limit you to 500 sites either)

On a more serious note though, its nice to see Google validate our assertion, that un-modified Google search results are getting poorer and poorer. Not that they would actually say it directly like that of course. Now lets see if they are willing to drop over a million crappy sites out of their index ...

Re:Google: Hide sites to find more of what you want by ChuckMcM on Thursday March 10, 2011 @05:05PM (#2311007)
FWIW, in my experience one of the more difficult aspects of starting and growing a company is knowing if what you believe is true, or just something you want to be true.

So you go to start a company and you say that you believe the search experience is getting worse and worse. That you believe the leader in the market place is fighting a losing battle of trying to algorithmically determine relevance in a world where humans will actively work to subvert the algorithms. That the world would be a better place if a more customizable search experience existed.

A common response is "Well if this is such an important idea they would already be doing it."

So as an entrepreneur you deal with the naysayers and you build something which other people have "... been clamoring for a blacklist for years" and yet has never materialized. And you put it out into the market.

Right up until you deliver your product, nobody knows who is 'right' in this back and forth. It is all academic. You've built the best product you know how to build, you offer it up to the world, and when you ship the debate stops being academic and starts becoming empirical.

When the market leader adds features that mimic ones you've launched with several months ago, it can be simply timing (they may have been going to do it all along and it just happens that they did it now), it can be a response, it can be random I suppose. Regardless of why they did it, it seems to be an unequivocal damnation of pure algorithmic search.

As one of Blekko's founding concepts was that the search experience can be made better by human curation, I choose to interpret it as validation. Not that I expect Google to join in and adopt the "web search bill of rights" anytime soon of course.

Re:Google: Hide sites to find more of what you want by chc on Thursday March 10, 2011 @05:50PM (#2311161)
I don't think it's fair to call this "an unequivocal damnation of pure algorithmic search." The search is still purely algorithmic. This just allows individual users to choose which results are interesting to them in particular. A particular human's (or group of humans') curation would not be a perfect fit for everyone either.

Similarly, I don't see the ability to choose whether you're doing an image search or a news search as a condemnation of algorithmic search either.

Re:Google: Hide sites to find more of what you want by ChuckMcM on Friday March 11, 2011 @01:10AM (#2312344)
Perhaps its an overstatement, but you have to recall that Google's "I'm feeling Lucky" button was designed to be the one page they had deduced you were looking for, their stretch goal, a results page with one link. The one they know you're looking for.

Now they have backed off on that, with reasoning that it is really not truly possible given that the search "Sony XBR TV" might be you are looking for the manual for the TV or to buy the TV or something which isn't known, but the goal is always to have the result you're looking for on the first page. That has been their target and promise for years.

So by creating a feature, and putting it into production, to "block sites" it suggests to me that they are saying "Hey, we know our algorithm is failing and we have given up (perhaps temporarily) trying to fix it. We know it will put sites you don't want to see into the first page. Here is a manual tool to weed those out."

It seems like something of a philosophy change at least. Perhaps Matt will chime in.

Re:Google: Hide sites to find more of what you want by tblueski on Friday March 11, 2011 @09:36AM (#2313416)
I got to be honest. Blocking sites doesn't seem to be working that well for you guys.

Look at this search - "how to get pregnant" - that exact phrase gets 550K searches on google a month. My wife and I did this search last week actually.

Blekko's top 3 results are 1. get-pregnant-guide.com which is an affiliate site that points to pregnancymiracle.com - one of those crappy ebook sites where they have a bunch of testimonials and ask for you to pay $39.95 for their guide, 2. a digg post that has 1 digg which points to a hubpages article that no longer exists, 3. purelyfitness.com/how-to-get-pregnant which is also an affiliate site that points to pregnancymiracle.com.

Google's top sites are the mayoclinic.com, mahalo.com, and howtogetpregnant.net. The least useful to me was howtogetpregnant.net, but they still gave a decent amount free advice. I actually found Mahalo to be the most informative which is blocked from your results. I find Calacanis just as annoying as everyone else, but this page was more beneficial to me than even the mayoclinic.

Re:Google: Hide sites to find more of what you want by ChuckMcM on Friday March 11, 2011 @04:19PM (#2314970)
You are right, those results suck. However when you type 'how to get pregnant /health' those results seem to be pretty good.
Re:Google: Hide sites to find more of what you want by greglindahl on Saturday March 12, 2011 @04:38PM (#2317572)
The suggested slashtag for [how to get pregnant] is /pregnancy ... those results are pretty nice, albeit less medically-focused than the /health results.
Re:Google: Hide sites to find more of what you want by joe_the_user on Thursday March 10, 2011 @07:03PM (#2311377)
As one of Blekko's founding concepts was that the search experience can be made better by human curation, I choose to interpret it as validation. Not that I expect Google to join in and adopt the "web search bill of rights" anytime soon of course.

I'm not sure if "Human curation" is the concept I'd grope for here.

What I'd like is search that uses a "larger context" - what I've searched-for and accepted/rejected, what those similar to me have searched-for and accepted/rejected etc. Being able to implicitly use a lot of information is crucial because there aren't going to be enough curators to everything ever.

Google is already using an incredible amount of implicit information and I expect them to use more.

What I see opportunity as really, is more like "self-curation" than some finite stable of curators. What would be cool is a system to let me keep my list of likes and search-finds - essentially my entire preference-system - and let me edit and send the whole thing to different search providers as well as to friends.

Re:Google: Hide sites to find more of what you want by rsoto on Thursday March 10, 2011 @04:19PM (#2310837)
I just lost a little of respect from you guys with this comment.
Re:Google: Hide sites to find more of what you want by mistermann on Thursday March 10, 2011 @04:36PM (#2310893)
I didn't, I think its true. I'm shocked google actually did this, it will cost them money in advertising dollars, and I honestly thought some of their technical decisions were being driven by maximizing revenue at almost any cost, so this move seems to invalidate that theory. Kudos to google I say.
Re:Google: Hide sites to find more of what you want by lwat on Thursday March 10, 2011 @06:45PM (#2311303)
Losing users will also cost them money in advertising dollars.
Re:Google: Hide sites to find more of what you want by Andrewski on Thursday March 10, 2011 @08:18PM (#2311673)
SEO spam has no actual users bro.
Re:Google: Hide sites to find more of what you want by lwat on Thursday March 10, 2011 @09:52PM (#2311937)
I mean Google. They'll lose users if they don't do something about the SEO spam.
Re:Google: Hide sites to find more of what you want by digitaltothem on Friday March 11, 2011 @06:29AM (#2313014)
I completely agree. They must improve (or at least) maintain the quality of their search results to keep users. The fact that it is the most popular search engine is what brings in advertising dollars in the first place. So, the users are the key. SEO spam hurts them, just like it annoys us, so this is one of the attempts to fight it.
Re:Google: Hide sites to find more of what you want by Daniel14 on Thursday March 10, 2011 @05:27PM (#2311085)
You can afford not to limit users to 500 because no-one cares about gaming your system. Spammers are where the traffic is, so Google can't do that. But 500 sites are more than sufficient for me..
Re:Google: Hide sites to find more of what you want by magicalist on Thursday March 10, 2011 @05:27PM (#2311087)
one man's crappy site is another man's precious precious wikipedia (see: all the disagreements that have already come up here over what to block).

Personally I prefer knowing that those sites are in the index, but don't show up unless I purposefully widen my search to include them (or they appear so low in rankings that it achieves the same effect).

Re:Google: Hide sites to find more of what you want by tblueski on Friday March 11, 2011 @10:58AM (#2313740)
I 100% agree. When you say "Here" are you talking about this thread or other threads? I would like to see them.
Re:Google: Hide sites to find more of what you want by ffumarola on Thursday March 10, 2011 @11:46PM (#2312159)
For now, they are not admitting defeat:

"In addition, while we’re not currently using the domains people block as a signal in ranking, we’ll look at the data and see whether it would be useful as we continue to evaluate and improve our search results in the future."

Re:Google: Hide sites to find more of what you want by lololol on Thursday March 10, 2011 @11:39PM (#2312144)
Now just fix your search engine so your results aren't total trash and you'll be all set.
Re:Google: Hide sites to find more of what you want by arkitaip on Thursday March 10, 2011 @09:47PM (#2311925)
Most users don't even block 1 site let alone 500.