News for hackers. Stuff that matters.
Re:Robots.txt by dkhenry on Monday February 11, 2013 @01:08PM (#5202184)
Keep up the good work Google. I hope this serves as encouragement for them to continue to screw over those who want to turn searching for relevant information into a war for who can cheat the system the best.
Re:Robots.txt by CKKim on Monday February 11, 2013 @01:37PM (#5202380)
Totally with you. I was enjoying the amusing tone of the piece but he lost my sympathy at:

"Before, SEO was the game of really skilled people, you know like professional poker players. You had to know the game, know when to raise, and when to bluff."

Then with the "Maybe I should find another job?" I thought this has got to be satire. Well played, sir.

The way the piece is framed, the writing style, surely a work of humour?

Re:Robots.txt by bmac27 on Monday February 11, 2013 @01:50PM (#5202477)
I agree; that last comment gives it away. I've been doing enterprise-level SEO for several years now as a day job and it's not as if algo updates are so frequent and far reaching as to make it difficult to keep up with. Most major updates from Google and the other engines are predicated on two major themes:

-Rewarding relevant, informative, keyword-rich content focused on specific topics and punishing sites that construct thinly constructed (UGC or otherwise) pages, particularly those who do it in huge numbers.

-Rewarding sites who links from similarly relevant, authoritative sources gained organically and punishing those who acquire links through artificial means (either through direct purchases, purchasing domain portfolios with thousands of backlinks etc.)

There are nuances that are market-specific that require slightly different approaches and concentrations (e.g. health care) but those are the main things folks should concern themselves with. There's no black magic behind it unless you're doing something shady to begin with.

Re:Robots.txt by explicitlyme on Monday February 11, 2013 @03:10PM (#5202936)
It was meant as humour, for other SEOs in reality. Kind of an in joke that took the hard part of our job and made it funny. Frankly, as in any industry, you have to adapt. (I am the Author of that site)
Re:Robots.txt by illuminate on Monday February 11, 2013 @01:40PM (#5202407)
From his twitter postings, I don't believe this is fake.
Re:Robots.txt by CKKim on Monday February 11, 2013 @02:04PM (#5202586)
Ah, thanks for this and your comment elsewhere in the thread. That Twitter link, for those also intrigued: https://twitter.com/rishil.
Re:Robots.txt by websitescenes on Monday February 11, 2013 @01:38PM (#5202390)
Plus one. SEO is absolutely annoying. If a site is built correctly and there is interest in the service or topic the site provides, then the product will be found. Stuffing keywords into title and heading tags along with other grey area SEO techniques really devalues the internet. I see SEO along the same lines as buying domains that you think may have value and sitting on them. Games like this hinder progress and real utilization of the resources at our disposal.
Re:Robots.txt by dchuk on Monday February 11, 2013 @02:28PM (#5202724)
You clearly have no idea what SEO really is.
Re:Robots.txt by websitescenes on Tuesday February 12, 2013 @03:20PM (#5209233)
Of course, optimize your content so that it's easy to find and index. That's building your site correctly. All I am saying is that after market SEO is a little gimmicky because of the patchwork approach taken by many SEO specialists. As a longtime developer that has had lots of interaction with clients, I know they often spend their time worrying about SEO instead of posting good content. If a consumer isn't satisfied with search rankings and they think their site is poorly built, then they are better off contracting someone that will build it correctly the first time. Now obviously a dynamically served website has some SEO issues and needs some special attention, but this shouldn't be an after thought or third party component.
Re:Robots.txt by a5seo on Monday February 11, 2013 @03:12PM (#5202944)
"if a site is built correctly" - right. That's far from a given.

I can show you dozens of examples of well-funded "A list" too-cool-for-SEO developers who have no idea whatsoever what "built correctly" entails from the POV of a search engine.

The role of SEO is a) Product Management to set requirements to optimize crawlability, indexing, and retrieval, or b) QA that arrives after the fact and highlights all the ways the site fails to be usable for bots.

My experience is if you design things right first, it costs much less than if you don't. Plus you see the upside of your efforts quickly.

But maybe some people take the attitude that "giving me traffic is Google's job" and then when they don't get organic traffic, they have to buy it. Hopefully they also enjoy raising money and giving up a big chunk of their company, too.

Re:Robots.txt by websitescenes on Tuesday February 12, 2013 @03:12PM (#5209174)
"My experience is if you design things right first, it costs much less than if you don't. Plus you see the upside of your efforts quickly."

That's what I said.

Re:Robots.txt by morganwilde on Monday February 11, 2013 @01:18PM (#5202245)
Exactly what I thought, SEO should not have ever become a "thing" if Google did its job right.
Re:Robots.txt by illuminate on Monday February 11, 2013 @01:39PM (#5202402)
"SEO should not have ever become a "thing" if Google did its job right."

SEO will always be a "thing" as long as people are not always interested in providing relevant information. It will always be an asymmetric battle between people who want to prioritize their noise over useful signal.

Re:Robots.txt by pbhjpbhj on Monday February 11, 2013 @08:42PM (#5204687)
>SEO will always be a "thing" as long as people are not always interested in providing relevant information. //

SEO is [also] about bridging the gap between machine-based abstraction of the data in your site and human searchers. Most of the on-page/on-site optimisations are simply ensuring that the SE can abstract the right information so that users searching for the content you're providing can find it.

SEO will always be a thing as long as Googlebot fails to perfectly abstract the data content of a site and perfectly rank sites according to user needs.

Re:Robots.txt by illuminate on Monday February 11, 2013 @11:53PM (#5205235)
The discrepancy here is probably that "SEO" is mostly used as a pejorative versus the intentions you describe.
Re:Robots.txt by rlpb on Monday February 11, 2013 @01:32PM (#5202347)
There is still a case for consultants who understand how to make websites genuinely more useful and relevant. Then it's win-win. Their motives might be their rankings, traffic and profit, but if it improves the web for Google users, then that isn't necessarily a bad thing.

But the tone of this "article" makes this guy sound like he wears a black hat.

Re:Robots.txt by a5seo on Monday February 11, 2013 @03:06PM (#5202910)
Not to mention helping sites avoid crawl suicide like massively duplicating content across sites, implementing faceted nav and pagination wrong, putting core content in AJAX, generating thin pages, making Google guess which page is the canonical one, and product managers who think "hey let's republish this database of millions of items on our site with generate millions of pages."
Re:Robots.txt by explicitlyme on Monday February 11, 2013 @03:13PM (#5202947)
I don't really. I do believe there is value in learning the dark side of this profession though. There aren't enough genuine SEOs that really understand both sides of the equation.
Re:Robots.txt by a5seo on Monday February 11, 2013 @03:29PM (#5203015)
I used to agree with this, but lately I feel like any learnings are going to have a short shelf life. With the EMD updates and on-going refinements to Penguin, how long can any truly effective hack really be expected to work?

I'm glad Google is cleaning house b/c it became annoying trying to counsel people to not violate the Webmaster Guidelines when they could point to successful competitors or some backwater infomercial claiming they could shortcut their way by spamming.

The best strategy I've found is just to not shoot yourself in the foot in terms of site structure and IA, and invest in long-term value through link building with PR and content that naturally attracts links.

Re:Robots.txt by skulquake on Monday February 11, 2013 @05:05PM (#5203634)
I wish some of the "real" black hatters could come on here and speak. These guys are the ones putting together massive strategies/campaigns to rank across a wide variety of thousands of key terms. And there not writing about it. The techniques many people are talking about now were done maybe 2-3 years before this whole mess. They are so far ahead of what the "industry" is focused on it's not even funny.
Re:Robots.txt by a5seo on Monday February 11, 2013 @08:24PM (#5204616)
Some black hatters make money, but for every 1 who does, 50 don't. Spend some time on WarriorForum or SEOBook and you'll see a very low signal to noise ratio. Lots of people are just preying on people who want to get rich quick with now work by selling them hope in the form of "info products".

And the black hatters who make money could probably make just as much if they did something legit.

The worst part about black hat is eventually the wheels fall off and you have to start over. So you're playing a game that keeps you on a constant treadmill. It's just as bad as consulting as a way to make a living.

If you take the high road, you build real value you can exit on eventually.

Re:Robots.txt by thenextcorner on Monday February 11, 2013 @07:02PM (#5204299)
You know there is a reason they don't participate on these forums... It's a waste of their time! They are so busy working their strategy, making money on the web, that any time spent on a discussion like this, while no money is made, is very low on their priorities.
Re:Robots.txt by illuminate on Monday February 11, 2013 @08:48PM (#5204710)
I doubt they're making a ton on the hustle, but I agree that they're probably not the type to waste time discussing points with other, likely more hostile crowds.
Re:Robots.txt by thenextcorner on Monday February 11, 2013 @10:48PM (#5205094)
What makes you doubt that? If there was no money to be made, these wouldn't be spam, Viagra Wordpress hacks or Phishing attempts.

You have no idea...

Re:Robots.txt by a5seo on Tuesday February 12, 2013 @12:54AM (#5205412)
I've seen what some of them do, and it's not as impressive as you'd think. Most of it breaks and stops working inside of 24 months. Then it's on to the next scam. Not a lot different from fly-by-night snake oil salesmen.

Just the existence of spam doesnt prove it's a big oppotunity, just that it's better for some people than their opportunity cost.

Re:Robots.txt by explicitlyme on Tuesday February 12, 2013 @03:34AM (#5205788)
Some make &10,000 a DAY.

Ever looked at the payday SERP in the UK? Google can't control it. I know at least 3-4 people who make £100,000 a year with just basic level spamming.

If I scaled this technique http://explicitly.me/serp-sniffing-a-long-tail-keyword-strat... , I could make the same amount of money without breaking a sweat by dumping Adsense on there, and shopping affiliate links.

The point is I don't choose to.

Re:Robots.txt by a5seo on Tuesday February 12, 2013 @11:36AM (#5207815)
Thanks for posting that. It's funny-- your strategy is exactly the way I do lead gen for my customers. I wrote a bunch of software to sniff serps (great expression, btw) and find long tail keywords that will drive leads for the client.

Then we produce articles (we actually hire real journalists) to address the search intent behind the keywords. Then we post it on the client's site, and charge them for the leads we drive via organic search from that content.

The funny thing is, our customers just view it as "content marketing," not SEO. Search data (search vol, competition, etc.) guides our content strategy, but I don't view this part as either good or bad. Or even really "SEO". Why would anyone invest in content nobody is searching for?!?

If we spun content or used Markov chains to generate gibberish or hired incompetent writers via TextBroker for $10 a story, sure that's spam.

But my calculation is that spending $500+ on an article written by a journalist with domain expertise is going to win long term. And since the lead revenue makes the ROI calculation >1, why not invest in quality?

And we definitely don't make Google guess what keyword we think our article would help.

Re:Robots.txt by explicitlyme on Wednesday February 13, 2013 @08:29AM (#5212943)
thats the route I would take as well. But, I would use SEMrush to sniff out the rankings for Demand Media and other content farms, and then create quality content to target those keywords, trying to displace their crap hat content.
Re:Robots.txt by a5seo on Thursday February 14, 2013 @03:31PM (#5221977)
ugh, consumer... cpms are too low! :-)
Re:Robots.txt by chatmasta on Monday February 11, 2013 @02:13PM (#5202641)
As long as search results are determined by algorithms, there will be search engine optimization. Why? Because every algorithm can be optimized for something. And as long as search engine optimization exists, engaging in it will be a competitive advantage. Why would you NOT want your site to appear at the top of the search results for as many keywords as possible? Your job as a business owner is to bring as many customers to your business as you can. To suggest anything else is absurd.

I'm happy that so many HN readers are anti-SEO, because that's less competition for me.

Re:Robots.txt by schiffern on Monday February 11, 2013 @02:20PM (#5202670)
Google's ultimate goal is making "SEO" and "quality content generation" one-and-the-same.

>Your job as a business owner is to bring as many customers to your business as you can. To suggest anything else is absurd.

Technically your job is to generate as much profit as possible. Volume of people in the door is but a single coefficient in that equation. It's a common failure point, yes, but suggesting that it is the only one is disingenuous.

Re:Robots.txt by Bradosaur on Monday February 11, 2013 @02:20PM (#5202667)
Just because something is good for my business, doesn't mean it's good for society. SEO (beyond actually making your site more valuable) is a classic prisoner's dilemma.
Re:Robots.txt by chatmasta on Monday February 11, 2013 @02:31PM (#5202745)
I think this is where my views differ from many on HN. As a business owner, I will do whatever is best for my business, without regards to what is best for society. My job is not to worry about what is best for society -- that job belongs to the government. The government sets the rules and we play the game. As long as I am not breaking any laws, I will do whatever it takes to bring my business to the top. I have to do this because if I don't, somebody else will. Riding a moral high horse will only lead to my business being stampeded by others who are willing to engage in tactics I am not.

This is not to say that I actively work against what's best for society. My point is that I will do what's best for my business, with regard to nothing else. I think that is what makes a good business owner. Another trait of a good business owner is the belief that his business provides the best value in its market. If you truly believe that, then by engaging in SEO to rank your business at the top of its market, you ARE doing what's best for society. If you suggest that engaging in SEO tactics to rank your business at the top is BAD for society, then you are inherently suggesting that your business does not provide the best value to its market.

Re:Robots.txt by lolcraft on Monday February 11, 2013 @03:08PM (#5202919)
I sympathize, but take notice that this is part of the classic one-two strategy that capitalists, as a class, have historically used to gain a disproportionate amount of power in certain historical periods. Say, the 19th century, or the 80s/90s. Not with malice, or even consciously, of course, but it's worth to watch for it, lest we fall again, and again...

First, claim the reasonable principle that law should guard morality, and business should attend only to business. It's in principle correct, so it gets accepted by everyone. So, if child labor were allowed, business owners would be in no moral fault for hiring kids to mine ore -- to pick a extreme example.

Second, claim that economic progress is good for everyone. Again, very reasonable. Then, organize as a political class (say, in nowadays Republican party) to get some legal concessions that were morally abhorrent in the past legal framework, in more or less degree, but would bring economic progress (for some definition of it). Say, legalize child labor. Voilá.

Now, it's obvious that capitalists should be, of course, allowed to organize politically. But, I argue that we live in a world disproportionately controlled by capital (specially the US), for various reasons. It's disingenuous, thus, to be a capitalist and have your mindset. You, as member of a class, have certain privileges that other classes in our society would consider unfair. Our current legal framework is loaded in your favor, after all.

Re:Robots.txt by csense on Monday February 11, 2013 @06:15PM (#5204057)
The "if you don't, then somebody else will" argument only applies if you're in a commodity market: A market with a lot of players selling the same product, or a market where there are few barriers to entry keeping out people who sell an interchangeable product.

Much of the world inhabited by HN'ers is not like this. If you have a typical software or web product, then a competitor would have to spend substantial resources developing code that duplicates your functionality, and then they have to worry about the head-start the first mover has in branding and network effects.

Re:Robots.txt by adonisn on Monday February 11, 2013 @02:41PM (#5202788)
its not that people are anti-SEO, its what you so-called "seo experts" think SEO is. As far as I'm concerned, optimizing for search engines means using best practices in designing the website. That includes, rich content, proper title and description meta, link text and title that describes the destination properly, alt/title for image and proper use of headings. SEO and accessibility go hand in hand. The marketing aspect of SEO, is integrating social media and targeted advertisement. If what your content is worth it, link building should come naturally. If you go beyond these practices and try all these scams to build fake reputation for your worthless website then you truly do not deserve to be on the internet. Trying to scam your way up the SERPs is an awful thing to do and it just ends up pushing better qualified website down, eventually, ruining the online experience for millions of people who now have to take more time out of their lives to find the relevant information they need. SEO is a must for every website, but if you try to scam your way up the ladder, you deserve to be thrown off it.
Re:Robots.txt by buster on Monday February 11, 2013 @01:09PM (#5202189)
Exactly my thoughts.
Re:Robots.txt by jeremyjh on Monday February 11, 2013 @01:24PM (#5202293)
Amen brother.