News for hackers. Stuff that matters.
Re:A search engine that removes the 1 million most popular w... by cousin_it on Wednesday November 27, 2013 @01:26PM (#6810030)
Here's another similar idea, someone please do this: a search engine that excludes all "commercial" sites. "Commercial" means the site contains ads or accepts payments.
Re:A search engine that removes the 1 million most popular w... by oneeyedpigeon on Wednesday November 27, 2013 @02:25PM (#6810447)
It's almost as if there's a need for a top-level domain to distinguish between commercial organisations and non-profits. This [1] was working brilliantly until everyone decided to abuse it left, right, and center.

[1] http://en.wikipedia.org/wiki/.com

Re:A search engine that removes the 1 million most popular w... by Laremere on Wednesday November 27, 2013 @03:06PM (#6810756)
The worst common day offender being .io.
Re:A search engine that removes the 1 million most popular w... by nwh on Wednesday November 27, 2013 @07:37PM (#6812310)
.io is a generic TLD in most books now anyway. There's lots of other ccTLD that are fairly useless, though it's obvious why ones like .co.ck (the uninhabited Cook Islands) were never picked up as generics.
Re:A search engine that removes the 1 million most popular w... by lobotryas on Wednesday November 27, 2013 @04:45PM (#6811353)
This would exclude SO (ads) and Wikipedia (accepts payments as donations).

Even of you refined your criteria, what do you have against sites that try to recoup costs of hosting or content? Or, are you referring to completely different sites, lumping them all under "commercial sites" label?

Re:A search engine that removes the 1 million most popular w... by cousin_it on Wednesday November 27, 2013 @06:00PM (#6811792)
Okay, it seems I was trigger-happy in excluding nonprofits that accept donations. Maybe "accept payments for products or services" would work better? Not sure how to formalize that though.

More generally, I don't have anything against any sites, I'm trying to come up with a way of viewing the internet that would have a high signal to noise ratio. It seems plausible to me that excluding all sites with ads would improve the signal to noise ratio over what we have today. If you think the signal to noise ratio would be improved further by carefully including some sites with ads (SO is a good example), can you take a stab at defining the criteria?

Maybe include only sites whose ads are deemed acceptable by adblock? But then we might include many content farms...

Re:A search engine that removes the 1 million most popular w... by mlinksva on Wednesday November 27, 2013 @02:08PM (#6810346)
Indeed, the first part (search that filters out site with ads, including affiliate links and the like) is something I wish for frequently. It isn't that I mind seeing ads (I can use AdBlock for that, and sometimes do), it's that I don't want to wade through spam sites when looking for info, and sites with ads seems like an obvious hard filter. Maybe DDG or the like could implement filter.
Re:A search engine that removes the 1 million most popular w... by ry0ohki on Wednesday November 27, 2013 @02:19PM (#6810411)
I remember Yahoo actually had this as a Yahoo Labs thing way back in the day (when they actually did search). You had a slider that would make your results all research (if you are researching a bike) to all commercial (if you want to buy one).
Re:A search engine that removes the 1 million most popular w... by barista on Wednesday November 27, 2013 @02:43PM (#6810582)
What about sites like amazon that serve both type of content? Reviews for research and an option to buy?
Re:A search engine that removes the 1 million most popular w... by trentmb on Wednesday November 27, 2013 @02:56PM (#6810662)
You'd find them half-way on the slider.
Re:A search engine that removes the 1 million most popular w... by PhasmaFelis on Wednesday November 27, 2013 @04:40PM (#6811329)
"Contains ads" by itself is a pretty bad definition of "commercial site," and will exclude a whole lot of useful, high-quality sites that run ads to pay the hosting bills.
Re:A search engine that removes the 1 million most popular w... by Benferhat on Wednesday November 27, 2013 @01:41PM (#6810128)
> "Commercial" means the site contains ads

Your idea started out good. Sometimes I want to research a product before I go looking for a merchant. Blocking all sites that contain ads? Just use adblock if you're that fanatical.

Re:A search engine that removes the 1 million most popular w... by anjc on Wednesday November 27, 2013 @01:59PM (#6810276)
Presumably the idea is to define 'commercial' as a website with ads or accept payments, rather than removing sites with ads to increase viewing pleasure.

I think it's a good idea. It'd certainly help with the problem of blogspam etc.

Re:A search engine that removes the 1 million most popular w... by JeremyMorgan on Wednesday November 27, 2013 @03:40PM (#6810984)
Also, it's not the ads themselves, but sites that produce content for the purpose of serving up more ads. May not be as good theoretically.
Re:A search engine that removes the 1 million most popular w... by derleth on Wednesday November 27, 2013 @06:43PM (#6812045)
I think the idea was that the presence of ads indicates the advertisers had influence on content, which isn't true for a lot of websites which run ads.
Re:A search engine that removes the 1 million most popular w... by drakaal on Wednesday November 27, 2013 @06:56PM (#6812129)
I don't think that just because a site makes money it is a bad result. If you searched for "Used Jeep Grand Cherokee" Craigslist would be a good result. So would AutoTrader. Both break your rule.
Re:A search engine that removes the 1 million most popular w... by robertjwebb on Wednesday November 27, 2013 @07:09PM (#6812199)
I agree - such a search engine would not be as general as Google or Yahoo. But in sacrificing generality it might become better at handling certain types of requests. I am sure that given such a service the community of HN will make light work of finding out what they are :)
Re:A search engine that removes the 1 million most popular w... by drakaal on Wednesday November 27, 2013 @07:33PM (#6812292)
Also it would by hypocritical that it would block sites with ads but likely have to use ads to generate revenue.

As the owner of a search engine I can tell you search ain't cheap.

Re:A search engine that removes the 1 million most popular w... by robertjwebb on Wednesday November 27, 2013 @08:12PM (#6812457)
Yeah. Also, how do you computationally distinguish between a commercial and non-commercial site? Loads of grey areas.
Re:A search engine that removes the 1 million most popular w... by drakaal on Wednesday November 27, 2013 @09:08PM (#6812622)
Our Natural Language / Language Heuristics Engine can do this. We do to a small extent now, we haven't gone whole hog because I'm not sure I agree that commercial sites shouldn't rank. For things we determine to be reference searches we downrank sales pages, for things we determine to be shopping searches we uprank them.
Re:A search engine that removes the 1 million most popular w... by robertjwebb on Friday November 29, 2013 @07:12AM (#6819084)
What product are you developing the engine for?
Re:A search engine that removes the 1 million most popular w... by brownbat on Saturday November 30, 2013 @12:02AM (#6822355)
Now everyone is fighting to perfect the concept and the definition.

Bikeshedding I say!

If we're just making something interesting and different, not shooting to replace all search, imperfect definitions are a wonderful place to start.

Re:A search engine that removes the 1 million most popular w... by snoonan on Wednesday November 27, 2013 @08:10PM (#6812443)
Would HN be excluded as a commercial site? :)