News for hackers. Stuff that matters.
Re:Wikipedia starts work on $2.5M internet search engine pro... by jondubois on Sunday February 14, 2016 @09:49PM (#11101247)
I'm pretty sure that the spammer argument is just an excuse used by Google to allow them to keep their business practices out of public scrutiny. Google search results are biased in favour of content produced by those who have money and power.

Google ranks everything based on popularity - Not based on quality. Popularity and quality are two independent concepts and not necessarily related. That's something which Wikimedia understands but which Google doesn't.

Re:Wikipedia starts work on $2.5M internet search engine pro... by jonathankoren on Sunday February 14, 2016 @11:44PM (#11101560)
Google does take quality into account. That's the whole point behind static ranking algorithms. However, quality isn't some universal concept. I'd say the inevitable paper on gravity wave detection is highest quality on it, but it certainly isn't popular because it's impenetrable to the lay masses, unlike say a Wikipedia article, which falls into look-at-me-i'm-oh-so-smart territory when it gets into double gradients and other math formulas with more letters than digits.
Re:Wikipedia starts work on $2.5M internet search engine pro... by nl on Monday February 15, 2016 @01:54AM (#11101882)
If you think "spam" isn't the defining problem of web search then you've never tried building a search engine. It's 90% of the problem.

Google does take plenty of quality features into account[1]. PageRank is one of course, but that isn't some corporate conspiracy, it's that it is a good feature.

[1] https://moz.com/search-ranking-factors/correlations

Re:Wikipedia starts work on $2.5M internet search engine pro... by bitmapbrother on Sunday February 14, 2016 @10:37PM (#11101388)
I'd ask you to cite your claims, but we both know you can't. It's a pity your issues with Google cause you to pollute discussions with BS.
Re:Wikipedia starts work on $2.5M internet search engine pro... by userbinator on Sunday February 14, 2016 @11:17PM (#11101484)
Do a Google search for anything even slightly obscure, and you're likely to find the first page or so of results filled with highly-SEO'd sites that offer little in the way of deep, detailed content. The smaller sites which do have that content, but just haven't been SEO'd much, have been eclipsed. They're still there, but rendered nearly inaccessible.

Interesting discussion on a search engine that does sort of the opposite of Google: https://news.ycombinator.com/item?id=3910304

Re:Wikipedia starts work on $2.5M internet search engine pro... by nl on Monday February 15, 2016 @01:57AM (#11101887)
I hear this a lot, but I'd love to see an example (especially including the sites that should rank).
Re:Wikipedia starts work on $2.5M internet search engine pro... by luxpir on Monday February 15, 2016 @03:14AM (#11102082)
This may or may not be what you're looking for, but my freelance site just can't hit the front page in my industry when dozens of highly funded agencies can dominate it. I've published a 50k word industry-specific book on my site, have SEO'd as much as possible and have an older domain than those better funded. Won't link to it here, but it seems to be a real issue to me.

If a search engine let you differentiate and sort between content match vs pagerank match vs Adwords spend we might be able to mitigate the issue somewhat.

Re:Wikipedia starts work on $2.5M internet search engine pro... by cpeterso on Monday February 15, 2016 @04:03AM (#11102258)
btw, your site's redirect to the HTTPS version doesn't seem to work correctly in Firefox, Safari, or IE. After reading your comment, I was curious to learn more. When I typed in just your domain name plus CMD+ENTER (which adds "www." and ".com" to the address bar text in Firefox), I got a 404 page, not the 301 redirect to the HTTPS site. When I add "http://", the redirect seems to work.
Re:Wikipedia starts work on $2.5M internet search engine pro... by luxpir on Monday February 15, 2016 @08:38AM (#11103291)
Thanks for letting me know, and for the more detailed info - the redirect worked for the basic permutations I tested for (www.domain.com, and http://domain.com etc.) but I am redirecting non-www and www traffic to https://www. in Nginx. (Solution found, see edit below.)

I'd not heard of the CMD+ENTER method before, so thanks for the heads up. Still not entirely sure what Firefox is submitting in that case. Will test.

I wasn't referring to this site in the parent comment, but to my freelance site. I'll put that site in my profile for 24 hours just in case anyone wants to take a look.

EDIT: Fixed, as noted in reply to nl's comments. A recent change led to a redirect line being mistakenly commented out.

Re:Wikipedia starts work on $2.5M internet search engine pro... by nl on Monday February 15, 2016 @05:11AM (#11102539)
This.

I don't work in this area, but I'd say that 99% of the time I hear someone complaining about how Google is favoring sites that pay for advertising over them I find that they are making these incredibly basic errors.

For me, http://www.linguaquote.com/ gives a 404. It's only when I go to https://www.linguaquote.com/ that it works.

Re:Wikipedia starts work on $2.5M internet search engine pro... by luxpir on Monday February 15, 2016 @08:49AM (#11103347)
That's all well and good, and thanks for checking, but I wasn't referring to that site in the parent comment. The other site does have SSL enabled, but only recently and via Let's Encrypt. The issue is much longer standing than this.

So I'm afraid it's not quite as simple as you make out in this case.

In other news, I've just pinpointed the missing line in the recently changed nginx config for Linguaquote; the http://www block had it's redirect commented out. Still, for this site in particular Google Webmaster tools is set up for the https version where no errors have been reported and SSL Labs gave an A+ for the stapling, PFS, heartbleed etc. etc. efforts I went to. I don't think this redirect was having an adverse effect on ranking, but I don't expect this site to hit the front page just yet - much more content to add before aiming for that.

Re:Wikipedia starts work on $2.5M internet search engine pro... by nl on Monday February 15, 2016 @07:20PM (#11107062)
Is it bad form to quote myself?

I'd love to see an example (especially including the sites that should rank).

Re:Wikipedia starts work on $2.5M internet search engine pro... by luxpir on Tuesday February 16, 2016 @10:07AM (#11110258)
I put the link to the freelance site in my profile, which I only mentioned in my reply to cpeterso above - apologies for not making it clearer.

Will leave it there a bit longer in case you do come back to this thread as still genuinely interested in your opinion on the matter.

Re:Wikipedia starts work on $2.5M internet search engine pro... by petemc_ on Monday February 15, 2016 @07:19PM (#11107053)
One example I've experienced is searching for iphone jailbreak related stuff. Perhaps that's to be expected.
Re:Wikipedia starts work on $2.5M internet search engine pro... by kevingadd on Sunday February 14, 2016 @11:39PM (#11101544)
If you've ever read about the original PageRank algorithm, the parent post is a pretty reasonable way to describe it.

I have no idea what the current algorithm looks like but I'd be shocked if it somehow switched to evaluating the 'quality' of content, however one might do that with an algorithm.

Re:Wikipedia starts work on $2.5M internet search engine pro... by justincormack on Monday February 15, 2016 @12:26AM (#11101668)
Well they do have some quality metrics, like duplication with other content, words used and so on. I suspect more, eg writing style measurements, correlated with other things that are found useful. There is a lot that could be done without actually understanding the content, although if course it can be gamed.
Re:Wikipedia starts work on $2.5M internet search engine pro... by jondubois on Monday February 15, 2016 @01:38AM (#11101849)
The primary measurement used for Google's PageRank algorithm is the number and "value" of backlinks that a page has. The "value" of a backlink is determined by the cumulative number of descendent sub-backlinks that it has. This is common knowledge among SEO professionals.

Basically, when judging quality, Google is making assumptions like: "This page has a lot of backlinks, and those backlinks themselves have a lot of backlinks... Therefore this page is of high quality." This approach puts all the power in the hands of content providers (bloggers) who are funded by big companies (or well-funded startups) and who serve the interests of those companies.

Google wrongly assumes that content-providers serve the interest of consumers and that they can be trusted - Which is not the case.