News for hackers. Stuff that matters.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by dangrossman on Monday February 22, 2010 @04:01PM (#1143705)
While it's always a bit annoying to see a meme take up article slots on Hacker News regularly, I don't mind this one. I see sites like Mahalo as doing massive disservice to huge numbers of people --

* thousands of AdWords advertisers that have paid for their ads to be matched with content sites, not scraper pages with a huge ad to text ratio

* thousands of publishers whose work is being scraped, aggregated and outranked without as much as a backlink

* millions of web searchers that are hitting these pages instead of the real sources of the content they were searching for

And calling out companies that harm the fabric of the web for everyone else is worth doing.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by w00pla on Monday February 22, 2010 @04:26PM (#1143775)
The question is: why doesn't google do anything about this? There are countless such pages. Why not just blacklist domains? Or artificially give them lower pagerank?

Or is it okay as long as they get ad-sense money?

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by moultano on Tuesday February 23, 2010 @03:24AM (#1145001)
I work for Google, and while I don't know anything about this particular situation, one invariant that I've been consistently impressed with is that the ads side of the company doesn't influence the search side of the company _at all_. I've seen well meaning ads support folks emailing people in search quality about an innocent problem with one of their customer's sites, and getting sternly told that they should never again send an email to those mailing lists.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by newman314 on Tuesday February 23, 2010 @03:44AM (#1145019)
Offtopic but I for one would like to see Google do this for personal information or at least provide the option to do so i.e. info from one G product does not leak to another without explicit opt-in.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by dlib on Monday February 22, 2010 @05:14PM (#1143894)
Isn't there a search engine out there that takes into account the advertisements vs. content ratio? It would be trivial to get rid of Made for Adsense sites by scanning for the Adsense code used and seeing how often it's used on a page and the percentage of the page it takes up.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by epi0Bauqu on Monday February 22, 2010 @05:31PM (#1143936)
Duck Duck Go tries to do this.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by skinnymuch on Monday February 22, 2010 @09:11PM (#1144395)
Google allows you to have three ads though. If you had a page with three ads and the best written 500 word article on it's topic, your definition of MFA sites would have it banned even though it is obviously a ton better than most sites around.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by prawn on Monday February 22, 2010 @10:01PM (#1144469)
For smaller publishers, it's usually three blocks of ads plus two blocks of link units. For those not familiar with AdSense, link units are the horizontal or vertical lists which take the visitor to a search results page rather than straight to an advertiser's page.

I think a strict definition of MFA is always going to be a little grey, but there's clearly something wrong with pages that are nothing other than widgets, scraped content and the like.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by moultano on Monday February 22, 2010 @06:30PM (#1144076)
There are a lot of good results that have a similar ratio of ads to "content" unless your definition of content is very sophisticated.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by vaksel on Monday February 22, 2010 @04:46PM (#1143815)
they do it all the time, as long as it's a small site, Mahalo's existence basically flies in the face of all of Google's rules and regulations
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by fnid2 on Monday February 22, 2010 @05:08PM (#1143876)
An old boss told me, "When you're the man, the rules don't apply to you."

Not to say that Calacanis is the man, but to illustrate that rules are there to suit the rule makers and in this case, it suits the rule makers to ignore their own rules.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by gcheong on Monday February 22, 2010 @08:00PM (#1144258)
So why didn't Google nip Maholo in the bud when it was starting out? Insider connections?
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by skinnymuch on Monday February 22, 2010 @09:09PM (#1144391)
They went through a bunch of different iterations and stuff before they established as the site they are now. And look at the funding of Mahalo and Google. Same early people.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by vaksel on Monday February 22, 2010 @09:03PM (#1144377)
because when they launched they were being touted as a search engine, not a content farm
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by noodle on Monday February 22, 2010 @04:52PM (#1143835)
they do block domains, at least from their organic search engine results.

i accidentally got one of mine blocked when playing around with some random software that produced a site that was somehow against their TOS. i didn't have it live long, but long enough for the spiders to grab and flag. still waiting on a reconsideration request.

why not mahalo? who knows. if i had to venture a guess, i'd say that the larger the site and the more revenue google sees from that site due to adwords and the like, the higher up the chain the decision to block it has to come from.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by JulianMorrison on Monday February 22, 2010 @05:05PM (#1143866)
I think Google prefers to programmatically detect and blacklist behaviours, without too many innocent casualties - even if working out how to do that takes longer. They aren't interested in playing whack-a-mole.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by w00pla on Monday February 22, 2010 @06:24PM (#1144060)
Can they then at least pick one scraping site from all the others (to prevent duplicate information)?

Although this is perfectly legal, there is quite a few big sites that scrapes Wikipedia and adds ad-sense. If you are searching for a narrow topic, page 1-2 is WP and WP copies.

As a sidenote - I see that Google Search has upvotes, comments and deletes in the search - yet it does not seem as if anyone uses it. Why? Why can't the user at least blacklist sites?

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by pbhjpbhj on Tuesday February 23, 2010 @08:21AM (#1145302)
>If you are searching for a narrow topic, page 1-2 is WP and WP copies.

It would be good to have a "remove all pages with Wikipedia content" button on searches. Sometimes it seems half the results are simply Wikipedia copies.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by mvandemar on Monday February 22, 2010 @06:34PM (#1144081)
That's only if you are logged in, and it only affects that user.You cannot up/down vote the Google results for everyone.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by aaronwall on Monday February 22, 2010 @05:56PM (#1143993)
They do often play whack-a-mole at the lower level too...but they also take human reviewers into account so it is not so expensive on engineering time.

And at the higher level they absolutely do penalize people individually to send a message. Watch the opening of this video if you think otherwise http://blogoscoped.com/archive/2008-07-08-n14.html

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by skinnymuch on Monday February 22, 2010 @09:12PM (#1144399)
They've played whack a mole plenty of times. They do it daily. This isn't some random guess or 'I think' like you're saying. This is fact.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by qeorge on Monday February 22, 2010 @04:20PM (#1143756)
Its really a shame how low Google's standards are for AdSense. I've tried advertising in the content network several times, but each time I end up wasting so much time blocking MFA sites that I give up.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by wheaties on Monday February 22, 2010 @04:23PM (#1143761)
The rub is, if Google were to block all of Mahalo, a lawsuit would surely be filed.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by jonknee on Monday February 22, 2010 @04:29PM (#1143781)
And Mahalo would lose. Google penalizes SEO spammers hundreds of times every day. It's very easy to see that Mahalo does not follow the rules.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by sjsivak on Monday February 22, 2010 @04:26PM (#1143774)
I do not think anyone is asking for all of Mahalo to be blocked. The major issue is the insane amount of auto-generated pages that are not given a noindex call and are also added to the site map xml file.

These actions appear to be conscious choices to make sure that google will index these pages, which according to several sources, have nothing but "scraped" content and are therefore spam.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by seldo on Monday February 22, 2010 @05:31PM (#1143938)
Google is providing a free service in a field in which there is intense competition. I don't see what basis anyone would have for filing a lawsuit for not being indexed in Google.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by smallblacksun on Monday February 22, 2010 @08:54PM (#1144366)
They could argue that Google has a monopoly on online search, and that excluding people from their search results is an illegal restraint of trade. I don't think that such a case would be a cut-and-dry victory for Google if the spammer (as in this case) has the money to fight them.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by skinnymuch on Monday February 22, 2010 @09:14PM (#1144401)
Ridiculous. I don't know how the law works but I do know that if Google was to somehow lose a case like that, their entire search engine would be worthless incredibly quickly with grey hat/black hat people going crazy.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by moultano on Monday February 22, 2010 @05:44PM (#1143964)
Regardless, it still happens all the time.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by mars on Monday February 22, 2010 @06:19PM (#1144047)
agreed.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by danik on Tuesday February 23, 2010 @03:15AM (#1144991)
Although I understand your points the AdWords and search issues is googles problem. People pay for a product with flaws in it and google is selling, not Mahalo. Mahalo has the freedom to do whatever they want with their pages and they can't be held responsible for what google in it's turn does with them.

Now, stealing other peoples work, that is obviously Mahalos doing and should be a case for the court.

I'm not really sure what the point with this article is. Mahalo spams google - so what? It's up to them to do this and up to google to prevent it. Business is business, even on the internet.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by aresant on Monday February 22, 2010 @04:03PM (#1143717)
Here's one thing to consider : Google's algorithms for detecting the actual value of clicks for advertisers has improved greatly over the past few years.

If Mahalo’s traffic was utter crap, it would be dropped.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by mvandemar on Monday February 22, 2010 @04:23PM (#1143766)
"If Mahalo’s traffic was utter crap, it would be dropped."

That's not even close to true. If it were, there would be no AdSense for parked pages program. Their eye is still very much on their own bottom line, not the advertisers.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by aaronwall on Monday February 22, 2010 @05:49PM (#1143973)
Here is a link about how search monetizes when compared to content sites (~ 30 to 1!)

http://www.emarketer.com/Article.aspx?R=1007053

As an extension of that, sites which get most of their traffic from search often have the highest ad CPM values because the ad targeting is so relevant on the AdSense ads. And this is true even moreso now that Google is also using the referrer for ad targeting

http://adsense.blogspot.com/2010/02/better-contextual-matchi...

Scraper sites do quite well on the ad revenues front because most of the traffic is search driven, and because the content ends up so bad that the ads look all the more appealing.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by hernan7 on Monday February 22, 2010 @05:29PM (#1143931)
There's also the possibility that aggregator sites are actually useful for some portion of the Internet users (read: the "facebook login" set) and the advertisers that cater to them. Too bad "we" have to share Google with "them".
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by wmeredith on Monday February 22, 2010 @05:47PM (#1143969)
Not to be too cynical, but after several years in web marketing I've found that in this case "we" definitely do not outnumber "them." Not by any stretch of the imagination.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by hernan7 on Monday February 22, 2010 @06:21PM (#1144049)
That goes without saying.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by aresant on Monday February 22, 2010 @06:23PM (#1144055)
"Their eye is still very much on their own bottom line, not the advertisers."

I know for a fact that Google is balancing advertiser ROI against advertising spend and ensuring that they don't upset the apple cart.

However you are absolutely right that Google is maximizing their profit – having the ROI numbers in hand lets them drive down overall sales-from-adsense margins while still keeping the customer.

So my original point is that if Mahalo was flat out non-performing crap, it would be tossed.

An argument could be made though that they use the Mahalo stuff to grow ad inventory, while balancing out the ROI to their advantage since it likely converts on the lower end of the scale.

Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by dangrossman on Monday February 22, 2010 @04:24PM (#1143768)
My conversion rates from the content network have never been as high as search. I try new campaigns targeting both networks every once in a while but always end up either opting out or setting a much lower bid on the content side.
Re:Jason Calacanis Knows He's Spamming Google, He Just Think... by mwcremer on Monday February 22, 2010 @04:25PM (#1143771)
[citation needed]